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PREFACE 

The  Deportment  of  Defense,  like  many  other  large  organisations, 
pursues  a  policy  of  continual  introspective  examination  in  order  to 
identify  areas  in  which  improvements  can  be  made.  Typically,  these  staff 
analyses  are  meaningful  and  of  interest  only  to  selected  managers  within 
the  Department.  On  occasion,  however,  the  topic  is  of  such  general  in¬ 
terest  to  other  branches  or  agencies  of  government,  or  to  the  public  at 
large,  that  wider  dissemination  of  the  report  on  the  analysis  appears 
warranted.  This  final  report  on  Project  HINDSIGHT  is  considered  as 
falling  into  the  latter  category;  in  fact,  an  earlier  interim  report  on 
HINDSIGHT  received  wide  distribution. 

The  reader  must  appreciate  that  this  report  covers  only  a  small 
segment  of  a  much  larger  area  of  interest  in  the  dynamics  of  R£D  manage¬ 
ment.  The  object  of  this  preface  is  to  emphasize  that  the  Project  HIND¬ 
SIGHT  study  had  certain  clearly  recognized  limitations. 

The  approach  taken  in  Project  HINDSIGHT  was  essentially  retrospec¬ 
tive.  Twenty  recent  weapon  systems  and  major  military  equipments  were 
analyzed  by  teams  of  technical  specialists  to  identify  applications  of 
science  and  technology  that  were  not  utilized  in  predecessor  mi li tary 
systems  designed  to  meet  roughly  the  same  requirements.  The  evolution 
of  the  new  technology  represented  in  each  system  was  traced  back  in  time 
to  critical  points  called  "research  or  exploratory  development  ( RXD) 
Events."  The  RXD  Event  is  the  basic  quantifying  unit  in  the  study,  and 
is  defined  as  the  occurrence  of  a  novel  idea  and  the  subsequent  scien¬ 
tific  and  engineering  activity  in  which  the  idea  is  examined  or  tested. 
There  could  be  one  or  two  RXD  Events,  or  an  extended  chain  of  them, 
culminating  in  a  device  or  component  found  in  a  particular  system. 

The  teams  of  specialists  identified  710  unique  RXD  Events,  conducted 
the  historical  traces,  and  described  and  documented  the  related  activi¬ 
ties  in  terms  of  the  differential  amount  of  knowledge  that  accounts  in 
part  for  the  increased  cost-effectiveness  of  the  systems  analyzed,  com¬ 
pared  with  their  predecessors.  These  710  RXD  Events  represent  only  a 
portion  of  the  events  that  might  have  been  identified  by  a  more  exhaus¬ 
tive  analysis.  To  illustrate  the  gross  limits  of  the  study,  Project 
HINDSIGHT  concentrated  only  on  the  post  World  War  II  contributions  of 
science  and  technology  to  the  selected  systems.  Each  study  team  was  al¬ 
lowed  about  three  months  to  complete  its  research  on  each  system. 

in  treating  the  sciences,  HINDSIGHT  distinguished  (1)  the  basic 
research  done  to  solve  a  specific  assigned  problem  from  (2)  the  basic 
research  done  to  expand  the  frontiers  of  scientific  knowledge;  these 
were  categorized  as  directed  and  undirected  basic  research,  respectively. 
It  was  found  that  RXD  Events  from  the  directed  basic  research  category 
emerged  in  systems  development  approximately  nine  years  following  their 
conception,  while  it  took  20  or  more  years  for  some  events  from  the 
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Project  HINDSIGHT  h.is  provided  tl.it, 1  showing  th.it,  hiojtlly  sneaking, 
the  DoD's  requirements  ore  being  lullilled  by  the  results  ol  D<-l«.-ii-,<— 
•supported  research  ami  development  programs.  During  the  ly*i6-l‘jGjj  HIND¬ 
SIGHT  time  frame,  in  which  96  percent  of  the  identified  KXD  Events 
occurred,  the  DoD  spent,  about  $10  billion  in  support  ol  science  anil 
technology.  Also  .luring  this  period,  industry  and  other  federal  agen¬ 
cies  spent  about  $6  billion  in  tlte  same  areas.  It  niiybL  be  expected, 
then,  that  about.  bO  percent  of  DoD-utili/od  science  arid  technology  would 
come  from  theseother  sources.  In  fact,  Project  HINDSIGHI  found  that 
$5  percent  of  DoD-ut i I i zed  knowledge  came  from  scientific  and  technolog¬ 
ical  ac t iv i t i es  supported  either  directly  or  indirectly  by  the  Department 
of  Defense.  The  DoD  will  therefore  continue  to  ask  for  the  necessary 
resources  to  fund  and  manage  broad  research  and  development  programs 
that  are  responsive  to  our  short-  and  long-term  needs  for  weapon  systems. 

Some  results  of  Project  HINDSIGHT  suggested  that  the  interaction  of 
scientific  and  technological  knowledge  is  stimulated  by,  and  is  most 
productive  for,  weapon-system  development  in  a  problem-oriented  environ¬ 
ment.  The  dynamics  and  causal  relationships  between  the  researcher  in 
the  basic  sciences  and  the  applied  scientist  or  the  technologist  are  not, 
of  course,  completely  understood  or  defined.  However,  the  HINDSIGHT  data 
indicate  that  61  percent  of  the  RXD  Events  identified  had  a  specific 
systems  requirement  as  an  objective  and  that  over  85  percent  of  the  tech¬ 
nological  events  occurred  after  a  problem  appl i cations  group  originally 
defined  the  problem  to  be  solved.  This  finding  seems  to  support  the 
hypothesis  that  the  rate  of  transfer  and  utilization  of  scientific  and 
technical  knowledge  may  well  be  increased  when  a  specific  goal  or  system 
problem  provides  the  impetus. 

The  Department  of  Defense  recognizes  clearly  that  the  HINDSIGHT 
project  has  net  studied,  in  any  comprehensive  way,  the  influence  of  sci¬ 
ence  on  the  development  of  technology.  There  are  findings  here  which 
demonstrate  that  the  basic  research  community  clearly  contributes  to 
systems  development — for  example,  through  the  fundamental  process  of  ed¬ 
ucating  those  who  become  the  Inventors  and  users — but  the  study  did  net 
examine  the  role  of  basic  science.  The  HINDSIGHT  report  and  other  sub¬ 
sequent  analyses  of  the  interaction  between  science  and  technology  have 
not  altered  the  strong  philonophiaal  commitment  of  the  DoD  to  an<-aggres- 
sive,  high-quality  program  of  research  in  the  basic  sciences.  Such  a 
program  is  critically  important  to  our  future  national  security. 
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In  summary.  Project  HINDSIGHT  made  a  significant  contribution  toward 
,t  better  understanding  of  the  force1.,  and  environment  that  foster  tin*  f  low 
of  technology  into  weapon *sys  I  e»  development.  It  dues  not  represent  a 
total  or  final  answer;  rather,  it  is  one  element  in  the  national  effort 
to  enhance  the  management  of  research  and  development  resouttfcs. 
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I  XIXUllVI  SUMMARY 


Project  HINDSIGHT  was  establ  is  hud  by  tin:  Di  i-ucl.,r  ol  Defense  Iti-- 
search  aiul  Cng inner ing  in  his  memorandum  of  6  July  \(Jb‘j  to  flu:  Assistant 
Secretaries  (Research  and  Development)  of  the  Military  Departments. 

(See  Appendix  A;)  . 

Objectives  ami  Strategy 

The  defined  object ives  of  Project  HINDSIGHT  were: 

(a)  To  i dent i fy  those  management  factors  that  are  important 
in  assuring  that  research  and  technology  programs  will  be  productive  and 
that  program  results  will  be  utilized;  and 

(b)  To  measure  the  overall  increase  in  cost-effectiveness  in 
the  current  generation  of  weapon  systems  compared  to  that  of  their 
predecessors  (when  such  can  be  identified)  that  is  assignable  to  any 
part  of  the  DoD's  investment  in  research  in  science  and  technology. 

The  strategy  adopted  to  achieve  these  objectives  involved: 

(l)  Determining  the  extent  to  which  new  weapon  systems  are 
actually  dependent  upon  the  results  of  recent  advances  in  science  or 
technology  for  their  attained  Increase  in  system  effectiveness,  decrease 
in  cost,  or  Increase  in  cost-effectiveness  as  compared  to  a  predecessor 
system.-  >' 

!  1  ’’  (2)  Determining  the  proportion  of  any  new  technology,  required 

for  attaining  system  characteristics,  that  was  the  result  of  DoD-financed 
research  in  science  or  technology. 

(3)  Determining  significant  management  and  other  environmental 
factors,  as  seen  by  the  research  scientist. or  engineer,  that  appear  to  be 
commensurate  wi th  high  uti 1 ization  of  research  results. 

(4)  If  the  findings  of  the  first  Strategy  indicate  a  signifi¬ 
cant  rel iarice  on  new  science  or  technology,  devising  a  value-cost  index 
(or  set  of  -indices)  which  offers  a  quantitative  measure  of  the  return  on 
investment  in  research;  in  terms  of  the  enhanced  cost-effectiveness  of 
the  weapon  systems  made  possible  by  the  purchased  knowledge. 

The  study  efforts  were  organized  to  offer,  in  a  comparatively  brief 
period  of  time,  the  class  of  information  that  could  be  of  primary  use  to 
senior  management  levels  of  the  DoD  and  the  military  services.  These 
objectives  have  been  achieved.  This  report  describes  the  findings, and, 
where  appropriate,  suggests  their  implications.  More  detailed  informa¬ 
tion  which — although  It  might  have  some  policy  implications— is  of 
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greater  Interest  to  the  lower  managetneiU  echelons  within  the  sclent  i  I  it 
oinl  technological  communities  will  he  developed  Inter, 

The  study  personnel  consisted  ol  the  fol  lowing ; 

Ad  hue  t  earns  of  military  and  civilian  in-house  (DoD)  personnel; 

Consultive  and  part icipul ing  contract  support  by  behavioral 
and  tikinagemei  t  scientists  from  Northwestern  University  and  the  Sloan 
School.  Massachusetts  Institute  of  Technology; 

Contract  support  by  econometrics  scientists  from  the  Institute 
for  Defense  Analyses  (IDA)  and  the  Rand  Corporation;  and 

Voluntary  participating  support  from  five  industrial-management 
scientists. 

The  in-house  teams  were  concerned  with  establishing  the  amount  of 
new  science  or  technology  embodied  in  modern  weapon  systems,  ascertaining 
the  financial  support  for  this  science  or  technology,  and  defining  gross 
management  patterns.  The  university  and  industrial-management  scientists 
are  concerned  with  the  more  subtle  aspects  of  research  management,  in¬ 
cluding  idea  flow,  information  sources,  training,  individual  effectiveness 
and  motivation.  IDA  and  RAND  are  attempting  to  devise  credible  and  use¬ 
ful  value-cost  indices  for  research. 

Methodology 

Each  in-house  team  focused  on  a  single  weapon  system.  The  subsys¬ 
tems,  components,  materials  and  enabling  system  concepts  were  examined 
in  detai I  for  evidence  of  the  application  of  knowledge  resulting  from 
recent  research  in  science  or  technology.  Subsequent  to  the  recognition 
of  this  evidence, ‘each  team  undertook  an  investigation  to  ascertain  the 
source  of  the  hew  knowledge  and  the  circumstances  under  which  the  knowl¬ 
edge  was  generated  and  passed  to  the  eventual  user. 

The  basic  element  for  quantification  within  Project  HINDSIGHT  is 
the  Research  or  Exploratory  Development  (RXDj  Event.  The  RXD  Event  de¬ 
fines  a  scientific  or  engineering  activity  during  a  relatively  brief 
period  of  time  that  includes  the  conception  of  an  idea  and  the  initial 
demonstration  of  its  feasibility.  There  may  be  one  or  two  RXD  Events, 
or  an  extended  chain  of  them,  culminating  in  a  device  or  component  found 
in  the  studied  weapon  system.  The  final  fabrication  of  this  component 
or  device  may  or  may  not  involve  an  Event,  depending  upon  the  state  of 
the  technological  art  at  the  time  of  fabrication. 

Many  observations  derived  from  the  analysis  of  Project  HINDSIGHT 
data  confirm  widely  held  assumptions  of  successful  research  managers, 
and  in  these  cases  the  primary  contribution  of  the  Project  is  to  muke 
available  quantifiable  support  for  what  previously  had  been  informed 
opinion.  There  were,'  however,  some  significant  findings  wherein  the 
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data  contradict  some  general  ly  held  beliefs.  The  I ol lowing  paragraphs 
contain  ,1  summary  of  I  he  findings,  based  upon  analysis  ol  the  •  current  ly 
available  data;  and  some  filter  pretat  ion  of  those  findings. 

It  is  emphasised  that  this  study  identified  only  those  iricremeniai 
contributions  to  existing  bodies  oT  scionli lie  and  technological  knowl¬ 
edge  that  were  utilized  in  the  analyzed  military  equipments.  The  strong 
dependence  of  these  contribution  upon  the  total  base  of  science. and 
technology  must  be  recognized.  The  reader  is  cautioned  that  any  conclu¬ 
sions  regarding  the  Value  of  the  total  knowledge  base  cannot  be  validly 
drawn  from  the  findings  presented  here. 


HINDSIGHT  Findings 


(i)  Tht.'  uiout  i  filial- u»i  of  a  pea  i  fie  avail  In  in  science  or ■  technology 
'ivtsoaivh,  the  results  of  which  were  u lit iued  in,  Uriel  Mere  original  to , 
new  weapon  systems,  mis  faiaul  to  be  fairly  simple. 


For  most  of  the  systems  studi.ed,  on  the  order  of  100  to  150  post- 
19^5  contributions  from  the  scientific  and  technological  communities 
were  uncovered. >\.  Practical  limitations  in  time  and  resources,  however, 
permitted  only  a  smaller  number  to  be  examined  in  detail.  In  no  case 
did  the  study  team  feel  that  it  had  exhausted  the  possibilities  for  iden¬ 
tify  irig  add i tional  contributions.  Studies  of  the  Individual  systems 
were  terminated  when  the  study  team  and  the  Project  Director  were  quite 
certain  that  a  representative  sample  of  the  contributing  Events  had  been 
invest  igated  or  a  3-month  study  per  iod  rha'd,  elapsed ,  whichever  came  la¬ 
ter.  Estimates  of  sample  size,  made  at  the  completion  of  the  system 
study,  varied  from  20  percent  for  the  C-lAl  cargo  aircraft  to  75  percent 
for  the  LANCE  missile  system  and  over  95  percent  for  the  Mark  56. and  57 
Naval  mines.  u 


(2)  The  number  of  Events  that  were  easily  identified  varied  pro- 
poi'tionately  with  the  relative  increase  in  effectiveness  between  the 
studied  system  and  its  predecessor.  - 


For  example;  the  studies  quantitatively  demonstrate  that  more  new 
technology  was  required  to  progress  from  the  HONEST  JOHN  rocket  to  the 
LANCE  missile  system  than  from  MINUTEMAN  I  to  MINUTEMAN  II. 


(2)  No  category  of  performing  agency  was  found  to  be  significantly 
more  efficient  in  the  production  of  utilized  research  results  than  other 
categories. 


The  distribution  of  identified  RXD  Events  that  came  from  universi¬ 
ties,  industry,  or  the  in-house  laboratories  of  the  Military  Departments 
agrees,  to  within  a  very  few  percentage  points*-  with  the  allocation  of 
appl ied  research  funds  to  these  categories. 
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All  luiugh  the  prut"  i  table  work  t requent ly  was  t  loss  i  I  iahU:  «ts  applied 
research,  in  (tut  the  scientist  was  attempt  i  ng,  to  resolve  a  very  specific 
problem,  t t  dues  not  appear , that  specific  application  per  se  is  a  suffi¬ 
cient  criterion  for  predicting  usage. ■  Perhaps  the  most  important  factors 
in  establishing  a  high  probability  of  utilisation  are  the  degree  of 
awareness  (a)  on  the  part  of  the  scientist  concerning  who  in  the  engi¬ 
neering  community  needs  the  knowledge  and  (b)  on  the  part  ot  the  inter¬ 
ested  engineers  as  to  which  specific  scientist  is  working  on  the  problem. 
Accordingly,  research  managers  must  be  sensitive  to  the  need  for  commu¬ 
nication  between  the  scientific  and  engineering  communities. 


Four  secs  of  scientific  Events  that  assume  great  importance  because 
of  the  number  of  systems  that  rely  upon  them  are  readily  distinguishable. 
They  include  work  that  led  to  information  and  filter  theory,  inertial 
guidance  components,  rocket  engines  and  propellants,  and  transistor  tech¬ 
nology  with  its  associated  miniature  passive  electronic  elements.  In 
each  case  the  preponderance  of  the  research  effort  was  independent  of  any 
specific  weapon-system  development,  but  was  found  to  have  been  guided  by 
individuals  who  were  acutely  aware  of  the  detailed  problems  confronting 
design  engineers  and  of  the  limits  imposed  on  achievable  system  perform¬ 
ance  by  available  pertinent  technology. 


(5)  A  significant  number  of  important  scientific  contributions  aarnt 
fi‘oi'1  sources  other  titan  contemporarily  recognized  experts. 


investigation  of  a  sampling  of  these  Events  disclosed  a  fairly  com¬ 
mon  pattern.  The  performers  of  the  utilized  scientific  effort  and  their 
peers  were  mutually  aware  of  the  exploration  each  was  undertaking,  but 
there  was  marked  disagreement  regarding  the  merit  of  the  approach  that 
eventually  found  use.  in  each  case  the  successful  performer  broke  from 
the  peer  group,  moved  away,  and  found  new  funding.  More  than  anything 
else,  these  examples  point  out  the  necessity  for  ensuring  competition 
within  bureaucracy  and  the  necessity  for  maintaining  a  multiplicity  of 
funding  sources  for  every  scientific  discipline  and  area  of  technology. 


When  high  payoff  from  scientific  research  at  universities  was  iden¬ 
tified,  the  Scientific  research  was  coupled  closely  to  research  in  tech¬ 
nology  and  some  limited  development.  Typical  examples  are  the  inertial 
guidance  theory  and  component  work  at  the  Instrumentation  Laboratory, 
MIT,  and  the  propellant  research  at  the  Jet  Propulsion  Laboratory, 
California  Institute  of  Technology. 

'/V  ;  -  .  ’ 

Within  this  report,  undirected  basic  research  in  science,  as  de¬ 
fined  in  Table  III  (page  14),  refers  to  tasks  not  clearly  i deni i liable 
as  part  of  a  larger  program  that  was  coordinated  by  u  mission-oriented 
agency.  In  general,  they  are  those  individual,  comparatively  small  ef¬ 
forts  undertaken  by  one  or  two  investigators  in  the  universities,  in 
s'is-c  not.-  Tor-prof  i  I  corporations  and,  to  a  much  smaller  extent,  in  ot  hi'  • 
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industry.  lliey  01  <•  rhoi  .iclci  i  /ed  by  1  ho  loci  that  they  weie  motivated 
ot  tin-  t  esoorchoi  1  s  level  by  so'iont  i  f  i  r  curiosity  unc-i  mJiuI.ii  ly  inquiiy, 
ond  writ'  supported  by  the  Dol)  upon  I  ectiyn  i  t  i  on  of  tin-  lelevonu;  ond  siy- 
niliioiieo  of  the  researcher's  proposal. 


/'ll  import  jut  payoff  from  scientific  research  bt  tin  i  ye  r  s  i  1  ie  s  bus 
been  through  the  schooled  '  scion l  i  sis  ond  eng  1  Hours  who  Idler  performed 
the  applied  research.  Of  the  1,795  individuals  identified  as  li.iv i  ng 
contributed  to  an  RXD  Event,  detailed  i  ii  format  i  on  is  currently  avai  loble 


on  511, 
rug.  Ill 
ly  upon 
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research 


of  whom  92  percent  hol  d  academic  degrees  in  science  or  c-ikj  i neer- 
e  observation  that  tlu;  practicing  engineer  tends  I  o  depend  large 
uni  fied  theory^. (e. g.  ,  Kepler's,  Newton's  and  Boyles'  laws  and 
s  equations)  suggests  that  u  major  payoff  of  undirected  basic 
is  through  knowledge  acquired  during  'undergraduate  education. 


During  FY  1965,  based  on  a  percentage  breakout  of  research  and 
development  funds,  approximately  26  percent  of  the  nation' s  sclent i fit 
and  engineering  talent  was  employed  directly  or  indirectly  by  the 
Depai.  inert. t_  of  Defense.  This  figure  has  remained  fairly  constant  over 
the  past  several  years;  .  As  a  major  user  of  these  resources,  the  DoD 
should  have  a  selfish  interest  in  ensuring  the  continued  supply  of  tal¬ 
ent  by  guiding  potential  ability  into  scientific  disciplines  or  techni¬ 
cal  areas  of  marked  military  relevance.  The  selective  use  of  research 
grants  and  contracts  is  one  way  of  affording  such  guidance. 


Complementing  this  knowledge  accrued  through  formal  education  is 
the  engineer's  later  recourse  to  codified  or  tabulated  information,  such 
as  engineering  handbooks  and  technical  references.  The  second  payoff,  of 
basic  scientific  research  is  identi fied  as  the  organization  of  research 
results  into  a  format  readily  available  for  gerieral  use.  in  this  way, 
new  concepts  of  everything  from  materials  characteristics  to  design 
techniques  have  been  widely  disseminated.  Management  criteria  intended 
to  enhance  the  usefulness  of  research  results  should  include  recognition 
of  the  importance  of  unifying  or  codifying: information  and  the  require¬ 
ment  that  the  objectives  of  supported  research  be  so  oriented.  Periodic 
surveys  should  be  made,  and  research  advances  in  particular  subject  areas 
should  be  consolidated  and  published  in  a  format  designed  for  use  by 
engineers.  - 


(i;)  The  greatest  payoff  in  terms  of  ideas  leading  to  enhanced 
weaptni  systems  has  resulted  from  research  in  technology — and  then,  vr 
the  research  scientist  or  engineer  was  intimately  amove  of  problems  of 
the  applications  engineer. 


The  transfer  of  science  to  technology  and  technology  to  application 
has  been  found  to  rely  heavily  on  personal  contact  between  individuals 
(see  Table  VI  ,  page  hi).  The  communication  link  is  of  critical  impor¬ 
tance,  both  for  advising  the  scientific  communi ty  about  real  problem 
areas  ond  for  disseminating  scientific  or  technological  knowledge  to  tile 
eventual  user,  the  applications  engineer. 
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predecessor  is  usually  not  (Ik*  nMtsequetHt*  ol  uni- ,  two  or  flin-v  *,t  lent  S  I  i  t 
advances  or  technological  capabi I i t ies  hut  is  the  sym-u|ist  it.  ol 

I0t>,  200  or  100  iiiivom es ,  each  of  which  alone  is  i elut I vely  in', icjni  I  is.,mt  . 
Those  hundreds  ul"  diverse  •idvonv.es  must  I  lien  fie  fitted  .mtl  od  justed  loi 
,t  unified  opor.it  ional,  weapon  system.  The  cltorut  teri  sties  of  each  advance 
must  be  carefully  "interlaced’1  wi  lit  those  of  other  advances.  this  is 
substant ialed  by  Project  HINDSIGHT  data,  which  generally  show  thal  sys¬ 
tems  appl  ieat  ions,  rather  than  new  science,  .  inspire  scieme  and  teth'nol- 
cuiy  for  advanced  systems. 
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Analysis  of  the  time  relationship  of  an  RXD  Event's  occurrence  to 
i ts  uti lizat ion  in  the  studied  system  reveal s  two  characteristic  patterns. 
Where  the'  weapon- system  development  progressed  directly  from  a  technolog¬ 
ical  base  (exploratory  development)  to  engineering  development,  there  is 
a  marked  peaking  of  Events  about  the  time  development  is  initiated,  with 
about  1(1  percent  fo-r -LANCE  and  60  percent  for  MINUTEMAN  it  occurring 
after  development  had  started.  This  situation  appears  to  be  incompatible 
with  current  procurement  poi icies  that  stress  fixed-price  development 
contracts  (with  or  without  Incentive  fee).  Where  the  weapon  system  pro¬ 
gressed  from  a  technological  base  tnrough  an  advanced-development  phase 
and  then  Into  engineering  development,  a  much  more  uniform  distribution, 
devoid  of  significant  peaks,  is  noted;  examples  are  the  Hark  56  and  57 
Naval  mines. 


Project  HINDSIGHT  did  not  investigate  system-management  aspects  of 
the  weapon  systems  studied.  It  is  understood,  however,  that  in  at  least 
three  cases  —  the  BULLPUP  ai r-to-surface  missile,  the  C-TA1  cargo  aircraft 
and  the  LANCE  missile  system — development  was  undertaken  after  assurance 
was  given  that  the  requisite  scientific  and  technological  knowledge  was 
in  hand.  The  Event-distribution  charts  adequately  demonstrate  that  these 
assurances  were  not  valid.  A  major  reason  for  the  lack  of  validity  be¬ 
comes  apparent  in  a  study  of  the  detailed  Event  descript  ons.  At  the 
time  an  advanced  weapon  system  is  proposed,  the  design  engineer  forms 
his  judgments  on  the  basis  of  experience  or  the  extrapolation  of  that 
experience— the  more  advanced  the  proposed  system,  the  greater  the  de¬ 
pendence  upon  extrapolation.  A  requirement  for  research  in  technology 
arises  when  the  extrapolation  proves  to  have  been  overly  opt imi st i c. 

In  view  ol  the  potential  economic  advantages  of  fixed-price  system- 
development  contracts,  the  matter  becomes  one  of  determining  how,  in 
the  light  of  Project  HINDSIGHT  findings,  it  is  possible  to  ensure  that 
such  a  contractual  situation  can  be  meaningfully  established  without 
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flu*  Murk  !>6  .uni  ')/  N.iv.il  mini". ,  developed  in  on  environment  Th.it 
currently  would  ho  considered  .idv.inced  dove I  opium  I  (Kl.L)  culei|ijiy  6.3), 
demons 1 1  ,ile  wli.it  c.iii  hi’  dmio.  Hie  app.ii  out  rule  lit  which  toe  liiioloyy 
was  introduced  -show*!  the  orderly  progress  that  is  possible  I  liroughoul 
development  in  the  absence  of  ,i  product  ion  comm!  linen!  oi  an  overly 
amhi l  ions  del  ivory  schedule.  The  investigation  disclosed  that.,  during 
The  early  development  years,  the  work  was  accomplished  at  'an  essentially 
constant  level  of  effort.  Fixed  sums  of  money  were  made  available  for 
invest iyat  ions  into  problem  areas  that  were  disclosed  as  the  system's 
design  look  shape.  Product  ion  did  not  start  until  a  prototype  demon¬ 
strating  that  the  problems  had  been  reduced  was  essentially  complete. 
These  examples  suggest  that  the  greater  use  of  prototype-system  devel¬ 
opment  in  the  advanced-development  category,  to  provide  focus  and  spur 
to  research  in  science  and  technology,  can  be  a  successful  prelude  to 
fixed-price  production  contracting  and  still  ensure  a  significant  in¬ 
crease  in  operational  performance. 

(10)  Vinii'ilitii  of  tvncavnh  t’uipenditun'ts  nan  bn  retained  }>*  niann 

of  htiroi  !>ut  tiytmiquco.  '  :  ;  V;- 

Alternatively,  fixed-price  development  contracting  might  be  made 
feasible  by  assigning  to  the  Government  project  manager  a  degree  of' 
control  over  a  portion  of  the  Military  Department's  technology  money' 

(R&D  categories  6.1,  6.2  and  6.3)  in  addition  to  the  engineering-devel¬ 
opment  (6.4)  money  committed  to  the  contractor.  This  would  allow  the 
project  manager  to  influence  the  development  of  the  necessary  technology 
for  his  system,  ensure  that  the  technology  money  was  in  fact  directed 
into  areas  of  established  military  importance,  and  by  keeping  the  fund 
in  the  6.1,  6.2  or  6.3  categories  give  visibility  to  expenditures.  It 
is  clear  that  the  use  of  this  technology  money  must  remain  responsive 
to  the  control  of  the  Government  project,  manager  to  be  parceled  out  as 
needed.  Obviously,  great  care  must  be  taken  to  ensure  that  these  funds 
don't  become  a  "bail-out"  resource  to  cover  nontechnical  management 
deficiencies.  Examples  of  the  successful  application  of  this  approach 
were  found  in  the  development  of  the  Mark  46  torpedo  and  the  AN/SPS-48 
radar. 

(11)  The  Doll  han  required  a  considerable^  amount  of  i.W  liyimolo.jn 
an^J  I  kin  had  U>  fund  moot  of  it. 

The  relative  ease  with  which  RXD  Events  contributing  to  the  capa¬ 
bilities  of  new  weapon  systems  were  identified,  the  number  and  diversity 
of  those  Events,  and  the  recognition  that  the  same  level  of  the  utilized 
science  or  technology  almost  never  existed  at  the  time  of  engineering 


development  of  an  tipei .llioiuiUy  simil.it  pi'edct  essm  %y*,!«*tn  i.ixiibinr  t  «j 
demonstrate  irrevocably  t  lull  a  cons  i  del  able  amount  «if  dlttly  new  letluinl- 
ogy  was  lequired  fur  an  advanced  weapon  system. 

It  is  estimated  the  Militaiy  Departments  spent  about  $10  billion 
during  1945-I9&3  when  most  of  the  identified  1  veil!',  occurred  (see  Appi-n 
dix  F).  For  the  same  years,  another  estimate  places  expenditures  (or 
research  in  science  and  technology  by  industry  and  other  non- Defense 
sectors  of  the  economy  at  approximately  $7  hi  1 1  ion.  Ihe  f  inding  that 
the  acquisition  of  85  percent  of  the  utilized  new  scientific  and  techno¬ 
logical  information  was  financed  by  the  Military  Departments  becomes 
significant  in  view  of  the  relative  size  of  the  two  amounts  expended. 

We  may  conclude  from  these  two  observations  l ha l  a  great  deal  of 
new  knowledge  was  required  for  an  advanced  weapon  system  and  the  De¬ 
partment  of  Defense  could  not  rely  on  other  sectors  of  the  economy  to 
generate  it.  This  conclusion  is  strengthened  by  the  finding  that,  of 
the  remaining  17  'percent  not  directly  funded  by  the  DoD,  9  percent  was 
paid  for  by  defense-oriented  industries  and  was  thus  indirectly  funded 
by  income  from  previous  Defense  contracts. 

/  '  !  ‘  •  •  .  .  •  ,  :  '  .  .  • 

(l"i  Tiunsfor  of  technological  information  in  at  a  vvutipuahlg  high 
level  w tthin  the  defense-oriented  community . 

Approximately  300  separate  organizations  or  corporations  have  been 
identified  as  having  contributed  to  the  fund  of  new  knowledge,'  About  20 
of  them  had  significant  responsibility  as  prime  contractors  in  the  devel¬ 
opment  of  one  or  two  of  the  studied  systems.  Despite  the.  great  number  of 
participants,  over  80  percent  of  the  RXD  Events  (but  an  estimated  20  per¬ 
cent  within  the  set  of  systems  studied)  are  known  to  have  found  applica¬ 
tion  in  more  than  one  weapon  system.  At  the  very  least,  therefore,  it 
can  be  claimed  there  are  strong  indications  that  information  transfer 
within  the  defense  engineering  community  is  at  a  usefully  high  level. 

The  Project  HINDSIGHT  study  did  not  attempt  explicitly  to  identify 
alternative  technologies  used  in  the  several  systems  where  one  of  the 
alternatives  theoretically  might  have  satisfied  all  users.  The  number 
of  cases  involving  such  a  situation  was  so  small  as  to  appear  statisti¬ 
cally  insignificant, 

(IS)  The  performance  of  the  in-house  DoD  laboratories  appeal's  to 
be  consistent  with  the  numerical  strength  of  their  professional  personnel. 

After  the  sources  of  the  utilized  new  science  and  technology  were 
identified,  it  was  possible  to  examine  time-dependent  trends  in  terms  of 
the  relative  productivity  of  the  various  sources.  As  far  as  new  science 
is  concerned,  the  available  data  are  not  statistically  significant.  A 
marked  trend,  however.  Is  observable  with  respect  to  techno log  leal  activ¬ 
ity.  Early  in  the  1945-1958  period,  about  51  percent  of  the  new  technol¬ 
ogy  was  coming  from  the  in-house  laboratories  of  the  Military  Depart¬ 
ments,  with  42  percent  from  induslry  and  7  percent  from  the  universities. 
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By  HVJ  tlio  b,ikim.i'  w.i-.  . reversed ,  so  (Inn  j b  pen  mil  w.r.  coining  iri.m  tin- 
IVIViWc  laboi'atoi  ios,  |jB  percent  I  rum  industry,  .uul  6  per  cent  from  tin- 
un  i  vorvi  lies  (prinuiri  |y  univLTsi  ty-i)|)ei<ili‘[l  ci-Mlci'.  siic.li  as  the  Itcsisirili 
Laboratory  lor  Hoc  Ironies  or  Ilia  Inst  runiunwit  ion  Laboratory  ui  MIT). 

Oii  ri  ni)  this  whole  t  inie,1  the  scientific  and  c-ngi  nee* ring  strength  of 
the  non-Dol)  community  essentially 'quadrupled,  while  the  strength  of  t  lie 
in-house  Defense  laboratories  less  than  doubled.  Thus,  the  change  in 
relative  output  appears  to  reflect  only  t  lie  re  I  at  ive  increase  in  strength 

Findings  Pertinent  to  Strategies  Used 

In  terms  of  the  four  strategies  employed  to  attain  the  primary  ob¬ 
jectives  of  Project  HINDSIGHT,  the  relevant  findings  are  summarized  here. 

Strategy  1 :  Determine  the  extent  to  which  new  weapon 
systems  are  actually  dependent  upon  the  results  of 
•  iViVH.f  adikvitfcs  in  science  or  technology  for  their 
attained  increase  in  system  effectiveness,  decrease  in 
cost,  or  increase  in  cost-effectiveness  as  compared  to 
a  predecessor  system. 

Findings: .  Markedly  improved  weapon  systems  result  from  skillfully 
combining  a  considerable  number  of  scientific  and  technological  advances. 

There  is  a  high  positive  correlation  between  the  relative 
sophistication  of  the  predecessor  and  successor , systems — or  the  relative 
increase  in  their  effect i veness— and  the  amount  of  new  science  or  new 
technology  utilized  in  the  successor. 

Strategy  2:  Determine  the  proportion  of  any  new 
technology,  required  for  attaining  system  charac¬ 
teristics,  that  was  the  result  of  DoD- financed  :v 

research  in  science  or  technology. 

Finding :  More  than  85  percent  of  the  new  science  or  technology 
utilized  in  weapon  systems  was  the  result  of  DoD-financed  programs. 

Strategy  3;  Determine  significant  management  and 
other  environmental  factors,  as  seen  by  the  research 
scientist  or  engineer,  that  appear  to  be  commensurate 
with  high  utilization  of  research  results. 

Findi nqs :  The  utilization  factor  appears  insensitive  to  classical 
differences  in  organizational  structure  or  profit  motivation  appearing 
between  U.S.  industry,  in-house  DoD  laboratories,  and  university-associ¬ 
ated  science  and  technology  centers.  It  may,  however,  be  sensitive  to 
differences  between  these  types  of  organization  and  the  classic  organi¬ 
zational  structure  of  universities, 
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Must  Ml  i  I  i/i'J  inw  Si  it'll!  i  !  (i  inlcriii.il  inn  €.,«lin-  lr«<ni  ur  : 
g.iili.Vil  ifstsii  t  h  prtiiiiMw.  uihIi*i  uikfii .  in  ii’S|itmsc  In  i  «n  ntjii  i /nl  liilcnsf 

|*t  til<  1  t'llis . 

lilt’  Httsl  usylul  rule  trf  sc  iflU-c  this  tjciict.il  ly  been  Uni 
of  prov idiog  phtfiHJMioiidlixjic.il  exp I. null  inns  lu  the  eiiij tnecr. 

riie  enyiiieer  uses  unifietl  sc  lent  i  f  ic  -theory  .mtl  cntiificil 
scientific  iiilorm.il  ion . 


The  proy  i.irii  of  i  escurch  in  technology  mi  fitted  toward 
specific  typos  of  oi|ui pinout  lias  been  a  j»arlic.ularly  successful  approach 
to  yener.it  iny  utilized  knowledge. 

Achievement  of  a  high  combined  invent  i vents s,  or  in¬ 
genuity,  and  utilization  rate  are  dependent'  upon  the  time  and  space 
coexistence  of  four  primary  factors— the  recognition  of  need,  a  source 
of  ideas  in  the  form  of  an  educated  talent  pool,  capital  resources,  and 
an  adequate  communication  path  to  potential  users. 

St ra*  'gy  A;  If  the  findings  of  the  first  strategy 
indi>  te  a  significant  reliance  on  new  science  or 
technology,  devise  a  value-cost  index  (dr  set  of 
indices)  which  offers  a  quantitative  measure  of  the 
return  on  investment  in  research,  in  terms  of  the 
enhanced  cost-effectiveness  of  the  weapon  systems 
made  possible  by  the  purchased  knowledge.  [This 
objective  has  not  yet  been  satisfied.  Relevant 
findings  serve  primarily  to  define  the  problem 
further.] 

Findings *•  A  number  of  factors  Identified  through  the  studies  made 
thus  far  tend  to  refute  the  possibility  that  any  simple  or  linear  rela¬ 
tionship  exists  between  cost  of  research  and  value  received.  They  in¬ 
clude  the  following: 

(a)  There  is  a  high  probability  that  any  given  scientific  or 
technological  advance,  if  used  in  one  system,  will  be  used  In  many  other 
systems.  Thus,  any  cost-value  index  must  either  apportion  the  research 
cost  among  all  utilizing  systems  or  attribute  a  portion  of  the  total 

value  added  by  each  utilizing  system  to  the  identified  RXD  Event. 

...  f. •  •  • 

(b)  Improved  weapon  systems  or  end-item  equipments  tend  to  be 

a  synergistic  rather  than  cumulative  consequence  of  the  several  embodied 
scientific  and  technological  advances.  Thus  the  task  of  apportioning 
value  added  becomes  complex.  •'  '  -■ 

(c)  The  relative  amount  of  new  scientific  or  technological 
knowledge  required  to  achieve  greater  effectiveness,  lower  cost  or  im¬ 
proved  cost-effectiveness  of  a  new  system,  as  compared  to  that  of  a 
predecessor  system,  increases  with  the  latter's  technical  complexity. 


1  Inis.,  any  i  i  mil’  iippi  ox i nun  i  on  in  measuri n<|  value  added  ,is  ,i  i  oir.i  'iiiinc  i' 
nl  research  expenditures  will  teiul  tn  bn  dclusniy  in  lh.it  t  •- 1  u>  n  on 
i  lives  i  mi'll  t  will  always  appeal  qi'eate!  when  an  impi  uvi-menl  I  ■.  made  in  a 
s  imp  Ic  system. 


As  a  final  noli',  two  mat  tin  s  must  bo  emphasized. 

First,  the  scope  of  this  study  atul  its  resultant  linijinijs  arc  1611- 
ceined'only  with  the  acquis  i  t  ieh  of  knowledge  csseiit  ial  to  the  I  i*c.lino- 
logical  ileve  I  opulent  of  a  weapon  system,  Questions  concern  i  nq  the  use  or 
value  of.  the  results  of  research  in  the  behavioral ,  life  envi  'Oilmen  ta  I 
or  social  sciences  were  not  addressed. 

■  Second,  none  of 'the  findings  described  above  should  he  interpreted 
as  a  disavowal  of  the  value  of  very  fundamental  research  in  science.  It 
is  hardly  likely  that  the  transistor  could  have  been  invented  by  people 
who  sought  a  smaller",  more  rugged  electronic  signal  amplifier  but  were 
unversed  in  wave  mechanics  or  the  theory  of  electrons  in  solids;  that  a 
search  for  new  power  sources  would  have  led  to  the  nucleus  of  the  atom 
in  the  absence  of  the  work  of  Curie,  Fermi  and  others;  or  that  radio  or 
telephone  communications  could  have  been  invented  without  the  research 
efforts  of  Hertz,  Maxwell,  Marconi  and  their  fellows. 

The  findings  suggest  only  that  defense  research  is  most  likely  to 
culminate  in  utilization  when  deliberate  attempts  are  made  to  relate  the 
research  results  to  the  problems  of  the  mi  1 i tary  services. 


I .  INTRODUCTION 

Piojct  t  HINDSIGHT  is  a  hh.Ioiic.il  suf  vey  of  the  process  by  which 
model  ii  weapon  systems  «nnl  current  operational  procedures  acquire  their 
scientific  and  lechnc.logi c.i  1  buses.  The  studies  are  focused  on: 

(1)  the  people  who  can  be  identified  as  having  played  signif¬ 
icant  roles  in  the  acquisition  of  this  knowledge,  the  management  environ¬ 
ments  iri  which  they  worked,  and  the  behavioral  patterns  they  exhibit; 

/  (2)  analysis  of  the  utilized  technology,  time  distributions 
between  a  discovery  or  invention  and  its  application,  uniqueness  in 
terms  of  areas  of  practical  application,  sources,  interaction  between 
the  recognition  of  requirements  and  the  generation  of  new  knowledge;  and 

(3)  econometric  Investigations  of  research  in  science  and 
technology,  estimates  of  the  value-cost  ratio  of  this  research,  and  de¬ 
velopment  of  new  analytical  tools  to  provide  management  measures  of  the 
effectiveness  of  research. 

The  lime  frame  of  primary  interest  in  the  study  is  the  period  from 
19*15  to  the  present  . 

The  history  of  military  support  of  research  in  science  and  technol¬ 
ogy  in  the  United  States  dates  back  almost  to  the  time  of  the  organiza¬ 
tion  of  the  ini  I  i  tary  services.  Although  the  resources  available  for 
commitment  to  these  activities  undoubtedly  fluctuated  with  national  pros¬ 
perity,  congressional  or  executive  moods  and  specific  exigencies  of  the 
services,  a  number  of  factors  combined  to  minimize  inherent  difficulties 
in  the  management  of  whatever  research  programs  existed  prior  to  19^0: 

First,  until  the  latter  part  of  the  1930s,  the  lack  of  mili¬ 
tary  interest  In  recognized  scientific  opportunities  limited  the  number 
and  scope  of  potential  investigations. 

Second,  the  research  potential  of  the  nation  resided  primarily 
in  its  universities,  and  communication  channels  between  the  academic 
and  military  communities  were  practically  nonexistent. 

Third,  the  total  funds  available,  either  in  terms  relative  to 
current  annual  expenditures  for  research  or  in  terms  relative  to  contem¬ 
porary  defense  budgets,  were  so  small  that  their  management  constituted 
no  problem. 

Fourth,  the  contemporary  practice  of  supporting  research  out 
of  the  development  program  for  which  the  knowledge  was  desired  afforded 
a  level  of  coupling,  or  visibility,  that  minimized  any  requirement  fo« 
separata  justification. 


Si. ii  [  i  iiij  .iliuut  I  ‘•<•Vfi.il  i  .11  t  m  ••  i  oiiili  i  iifil  Hi  tiiiiM'  ex t  i-nv  i  vi- 

fli.  i  iiili1-.  in  live  ilfltir.f  if.f.iitli  i'iiv  i  i  oimifii  1  .  I  uihI.uhch  1 .1 1  <li',if.v«i  if1, 
jn  l  lio  siifiKfs,  p.11  t  i  i  ii  1 .1 !  I  y  in  qti.il)  ( tun  pliy*.  i  1  •• ,  0  le.  i  1  niii  <  ••  .mil  ch.-ni- 
isiry,  li.nl  s  i  ijn  i  I  i  1.111I  I  y  ini.  rv.i’ii*d  oppor  I  un  i  I  i  f.  lur  ilflfii'.f  m  iinli-il 

I  fsf.  n'cli .  I  hi’  high  level  ol  Mipporl  given  lo  1  f.i-.ii  eh  1I111  in<j  Win  Id  W.n 

II  mu  only  resulted  in  tin-  pro!  i  IVr.it  ion  of  sc  i  mi  i  si  ••  within  and  nut- 
siili'  tlu*  mi  i  vo rs  i  t  if  s  ,  but  in  .nidi  l  ion  created  commin i c.i t  ion  channel', 
between  l ho  scientists  .liul  Iho  milil.ny. 

The  pot  on  I  i.il  nppl  i  1.1 1  ion  ol  now  know  I  edge  juom,  .1  mu  I  t  i  p  I  i  1.  i  t  y  ol 
.iilv.incoil  weapon  systems  anil  the  increasing  costs  of  research  combined  to 
introduce  a  concept  of  research  supported  separately  from  specific  weap¬ 
ons  or  weapon  systems.  An  unstable  post  World  War  1 1  political  environ- 
iiU'iit  encouraged  an  iterative  process  ol  acquiring  and  us i ng  new  knowledge 
leading  to  advanced  weapon  systems,  which  in  turn  established  requirements 
for  more  knowledge  to  enable  more  advanced  defensive  or  counteroffensive 
weapons.  This  provided  the  justification  for  a  steadily  increasing  level 
of  expenditure  for  research. 

Between  19^5  and  1 963  an  estimated  $10  billion  was  spent  by  the 
Mi  I  i  tary ;  Depai  tments  for  research  in  science  and  technology.  I11TY  1966 
alone,  $  I . A  billion  was  programed  for  this  endeavor.  In  both  relative 
and  absolute  terms,  the  rate  of  expenditure  had  grown  to  the  point  at 
which  searching  questions  by  "Management"  were  inevitable  and  cssenLial. 
Project  HINDSIGHT  was  established  in  order  to  determine  analytically— 

the  importance  of  research  in  science  and  technology  to  the 
Department  of  Defense; 

©  the  uniqueness  of  Defense  requl cements  for  research,  if  any; 

,,  management  factors  that  significantly  influence  the  produc¬ 
tivity  of  research;  and 

©  answers  to  many  of  the  other  questions  that  have  been  raised 
by  conscientious  administrators. 

Specific  questions  have  been  as  varied  as  the  background  and  inter¬ 
ests  of  the  individuals  posing  them.  However,  most  of  the  questions — or, 
more  precisely,  challenges  to  the  continued  support  of  research — may  be 
fitted  into  one  or  more  classes.  Some  of  the  primary  orientations  are 
suggested  below.  Each  is  presented  in  the  form  of  a  hypothesis  to  afford 
guidance  in  terms  of  pertinence  of  information. 

•  The  Department  of  Defense's  requirements  for  .informat  ion  in 
science  and  technology  can  be  satisfied  to  such  an  extent  by  research 
supported  by  the  National  Aeronautics  and  Space  Administration  and  the 
National  Science  Foundation  that  significant  reductions  can  be  made  in 
the  applicable  portions  of  the  Defense  budget. 
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e  Hu-  ituriMiily  It  iqlt- 1  i*ve  I.  *,tt|»|M»t  t  ul  b.i*.ic  wot  k  i *.  Jjr  c«lut  i  iuj 
si  iont  i  I  it  ,mhI.  t  m  Imi  i  ,f  I  i  itlm  tint  l  iuu  at  *i»i<  It  u  i.itt-  that  it  c  .inin.l  In- 
t*i  1 1*  cl  t"  >»■  I  <,  i)  it|t*-,t  t-tl ,  titH*t  |tt  flftl,  tli  ‘isotititutl  fit,  ot  pul  to  practical  une, 

•  Depot  t infill  of  Del  disc  iinm.itjemeiit  ul  It  in  *,«  ietit.t*  .mil 

.  •.  thituluqy  ,  in  01  tier  t  o  bo  lully  el  I  ft  live,  must  make  conip.irot  i  vr  ui',  t  - 
el'lecc  ivenesi  analyses  lor.  each  separately  'ulettl  i  liable  reseat  clt  eflott, 

•  S  inn  I  f  it  an  l  portions  uf  tin-  Odense  research  program  may  be; 
operating  at  or  near  a  point  ol  marginal  returns. 

0  The  support  of  scientific  research  in  Lite  universities,  by 
the  Department  of  Defense  jik)  at  current  funding  levels,  significant iy 
affects  the  availability  of  the  best  faculty  talent  to  teach  students.  . 

The  requirement  for  judgment  criteria,  implicit  in  each  of  these 
hypotheses,  suggests  that  an  analysis  of  the  historical  use  cif  research¬ 
generated  knowledge  cannot  alone  provide  fully  satisfactory  proof  or 
refutation.  Project  HINDSIGHT  recognizes  this  situation  and  adopts  some 
augmenting  hypotheses,  the  test  of  which  will  offer  further  evidence  for 
or  against  the  previous  set,  and  also  will  provide  some  guidance  to  man¬ 
agement  where  live  findings  are  less  than  satisfactory.  The  supplemental 
set  concerns  itself  with  management  factors  affecting  the  use  of  research 
results.  The  concept  implicit  in  this  approach  is  based  on  the  argument 
that,  if  the  management  factors  encouraging  Uie  use  of  research  can  be 
identified,  current  management  practices  can.be  comparatively  analyzed 
and  modified,  where  and  if  necessary.  The  general  themes  of  the  propo¬ 
sitions  tested  in  the  supplemental  hypotheses  include  the  following: 

Criteria — The  strategies  used  by  individuals  and  groups  in  the 
selection  of  research  tasks  whose  results  were  utilized. 

Control — The  nature  of  the  control  environment  within  which 
successful  groups  work;  the  degree  of  .freedom  of  choice  and  action  by 
the  various  levels  vis-H-vis  their  superiors  and  the  larger  environment; 
the  degree  and  nature  of  authority  over  fiscal  and  technical  matters  at 
the  various  levels. 

Skills — The  way  In  which  new  scientific  and  technical  skills 
are  developed;  the  role  the  skills  play  In  accomplishing  utilized  re¬ 
search;  factors  influencing  the  cost  and  time  of  moving  into  a  new  field; 
the  use  and  effectiveness  of  retraining  and  continued  graduate  studies. 

Interface — delations  between  the  successfully  performing  re¬ 
search  group  and  organizations  involved  in  other  phases  of  the  RDTSE 
{research,  development,  test  and  evaluation)  cycle;  the  significance  of 
communications  lag  and  distortion;  the  value  of  liaison  Individuals. 

Idea  flow — Conditions  in  the  immediate  (group)  and  larger 
(organization)  environments  that  influence  the  kind,  number,  source, 
communication  and  disposition  of  ideas  for  new  investigations. 
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list-  ut  i  ill  urnij t  ion~'  1  he  k  i  nil*,  id  '.(Ml  t  h  ‘.I  I  elegy  used  by  suc¬ 
cessful  iiuiiviilu.iis  anil  groups  in  obtaining  ti  i.linii.il  i lit m nut  inn ;  I  In- 
inf  I  pence  of  l  i  mi*  and  linam  i.il  and  i  oimuunic.it  ion  imf.l mints  on si-. in  li 
strategy;  the  influence  of  seal  ill  s  l  r  a  t  eqy  on  I  lie  .  |/i  mine  t  i  v  i  l  y  «>•  tin- 
i ml  i  v  i  ilua  I  s  .iikI  groups. 

The  -si  uJy  methodology  employed  in  the  Vai  Thus  Tasks  ni.ik  ing  -ip 
Project  HINDSIGHT  is  closer  i  boil  in  detail  in  section  2,  “Oh  jot  rives ; 
Strategy  and  Mo  l  Itoilo  I  oyy Conceptual  ly I  ho  procedures  are  siiiianji  i /c-d 
.in  the  following  porogrophs . 


Task  I:  RXI)  Events 

Research  in  science  and  technology  is  a  continuing  activity  of  the 
Department  of  Defense.  If  this  activity  is  of  value,  it  would  be  logi¬ 
cal  to  expect  that  a  generation  of  weapon  systems  would  evidence  the 
consequences  of  this  research  —  that  it  would  be  based  not  only  on  the 
scientific  and  technical  foundation  of  preceding  generations,  but  on  new 
knowledge  as  well.  This  assumption  provides  the  basis  for  the  historical 
studies  comprising  Task  I  of  Project  HINDSIGHT. 

The  Task  I  studies  constitute  the  Sole  basis  of  this  report.  For 
this  first  task,  20  modern  weapon  systems  or  military  end-item  equip¬ 
ments  have  been  examined  by  teams  of  experienced  scientists  and  engi¬ 
neers  for  evidence  of  science  or  technology  that  was  not  available  or 
was  not  utilized  in  predecessor  systems.  Having  recognized  the  appl ica- 
t ion  of  this  new  knowledge ,  the  team  undertook  a  deliberate  historical 
trace  of  the  component,  technique  or  idea.  The  objective  of  the  trace 
was  to  identify  the  people,  the  place  and  the  time  associated  wi th  the 
generation  of  the  knowledge  and  with  the  contribution  of  significant 
additions  by  which  the  techrtdlogy  reached  the  level  manifested  in  the 
studied  weapon  system. 

The  primary  reason  for  Initiating  the  studies  through  the  investi¬ 
gation  of  specific  weapon  systems  is  to  forestal 1  any  doubt  concerning 
the  value  of  the  scientific  or  technological  contribution.  The  focus  is 
on  utilized  results  of  investment  jn  research.  Project  HINDSIGHT  is  not 
concerned  with  management  of  weapon- system  development  except  when  les¬ 
sons  may  be  drawn  from  the  role  qf  project  managers  in  fostering  new 
scientific  or  technological  knowledge.  .  ,  : 

The  nature  and  depth  of  information  sought  by  the  Task  I  study 
teams  are  demonstrated  in  Appendix  G,  the  form  used  for  RXD  Event  de¬ 
scriptions.  At  the  completion  of  Task  I,  710  RXD  Events  had  been  iden¬ 
tified,  historical  traces  had  been  made,  the  related  act ivi ties  had  been 
described  in  terms  of  the  differential  amount  of  knowledge  that  accounts 
in  part  for  the  increased  cost-effectiveness  of  current  weapon  systems 
over  that  of  their  predecessors.  It  is  estimated  that  this  number  rep¬ 
resents  between  one-third  and  one-half  of  the  RXD  Events  that  might 
have  been  identified  by  a  more  exhaustive  analysis. 
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I u s k  II:  Bella  v  ioru  I  Studies 

ld*;k  1 1  studies  ‘.iiv  focused  on  tin-  beluw  ioi  ,i  I  tlnji.jclerisi.it.s  <>1 
individual',  wins  coni ribu led  Ur*  ul  i lived  knowledge:  M.m.jgcim-nl  .malysi*. 
are  performing  detailed  studies  of  a  sampling  of  organisation*,  and  indi¬ 
viduals  identified  in  Task  I.  Areas  of  investigation  include— but  ate 
not  limited  to — idea  transfer,  skill  development,  motivation,  utilised 
information  sources,  and  the  role  of  the  technical  liaison  man .  As  each 
study  is  completed,  the  results  will  he  reported,  ami  the  series  of 
topic-oriented  essays  will  be  consolidated  and  published  by  the  Office 
of  the  Director  of  Defense  Research  and  Engineering,  probably  not  until 
late  in  1967-  It  is  anticipated  that  the  behavioral  studies  will  be 
continued. 

Task  III:  Econometric  Studies- 

Task  III  addresses  the  problem  of  defining  and  implementing  a  tech¬ 
nique  (or  techniques)  for  the  quantitative  analysis  of  the  value  of  in¬ 
vestment  in  scientific  and  technological  research — its  value,  that  is, 
in  terms  of  enhanced  cost-effectiveness  for  the  resultant  weapon  systems. 
A  limited  effort  to  achieve  a  quantitative  value  differential — aqain,  in 
terms  oF  predecessor  weapon  systems — has  been  undertaken  by  each  of  the 
Task  I  study  teams.  To  the  extent  permitted  by  security  restrictions, 
their  findings  are  reported  here.  Although  a  more  rigorous  approach  is 
being  sought  by  the  Institute  for  Defense  Analyses,  a  useful  solution  to 
this  very  complex  problem  has  not  yet  been  found.  Efforts  are  continu¬ 
ing,  and  success  will  be  reported  if  and  when  experienced. 

*  *  * 

The  remainder  of  this  report  addresses  the  hypotheses  stated  on 
pages  2  and  3  to  the  extent  permitted  by  the  data  collected  through  the 
studies  and  investigation  conducted  under  Task  I. 

Because  a  number  of  research  procedures  were  invented  for  this 
study  or  were  adapted  with  marked  changes  from  procedures  commonly  used 
in  behavioral  and  other  social  science  research  efforts,  attention  is 
given  in  section  2  to  methodological  details  of  Project  HINDSIGHT.  This 
study,  descriptive  rather  than  normative  in  character,  concentrates  on  a 
very  special  class  of  act ivi ties— research  efforts  whose  results  are 
known  unequivocally  to  have  been  utilized.  By  focusing  on  this  special 
class,  Project  HINDSIGHT  accepts  the  risk  of  some  potentially  significant 
errors  of  omission.  The  most  apparent  of  these  are  discussed  and  their 
possible  consequences  evaluated  in  section  8,  "Methodological  Validity." 


*Note:  Tasks  II  and  III  were  discontinued  in  favor  of  other 
related  DoD  studies. 
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Ill  general,  this  report  pi  e-.ent  s  ohsei  vut  i  me.  <u  i  oik  I  us  i  mis  di.r.vn 
I  rum  ,i  fiist  analysis  ol  the  ml  lecled  data,  wi  I  li  •in  in  t  1.-1  pi  ••(  at  i  on  ;>l 
those  observations  in  lei  ms  ol  their  significance  to  manage i  s  ol  icmmu 
in  science  and  technology.  In  .1  veiy  ieal  sense,  this  is  ;.i  p.iilinl  ii  — 
port.  Attention  given  to  tin-  lilts,  behavioral,  11.1tur.1l  and  iiiatheiuat  i col 
sciences-'  is.Jiol  adequate  to  warrant  .in  extension  ol  the  recmmiiriid.it  ions 
uv  include  management  of  those  'disciplines.  Until  further  studies  .in- : 
completed ,  no  conclusion  can  be  reached  on  whether  or  not  implic.it  ions 
relotitn,  to  management  in  the  physical  sciences  are  app  I  i  cable  aciov, 
other  disciplines. 

HINDSIGHT  i,s  a  study  of  a  dynamic  sociological  situation.  It  can¬ 
not  bo  assumed  that  observations  and  f ihd i ntis  pertaining  To  any  given 
time  will  rcMiiain  valid  over  extended  periods.  Therefore,  the  necessity 
for  a  continuing  study  or  a  series  of  repealed  studies  is  suggested. 

For  this  reason  and  because  of  the  dynamic  situation,  Lliis  report  must 
be  considered  to  be  of  an  interim  nature. 


OliJiCTlVlS,  S I  RATI  GY  AND  Ml  IIIOUOl.OGY 

,  1  Oil  joct  i  vt*s 

I  hi*  priinniy  objectives  ul  Project  HINOSIGHI,  eslubi  i  shed  Ly  the 
DIivcUm  t>l  Defense  Research  uiul'  Eiiyi  nee  ring  (DDKM)  it*  July  !J6i>  (sue 
Append  i  x  A) ,  we  re  ns  ID  I  I  ows : 

(a)  in  I  lion  lily  mul  firmly  establish  manayeiiiutit 
factors  fur  research  and  technology  programs  which 
have  been  assoc ia led  with  the  utilization  of  result*, 
produced  by  these  programs;  (b)  to  measure  the  over — 
all  increase  in  cost-effectiveness  In  the  current 
generation  of  weapons  systems  compared  to  their 
predecessors  (when  such  can  be  identified)  which  is 
assignable  to  any  part  of  tlie  total  BgD  investment 
in  research  and  technology. 

The  DDRSE’s  memorandum  concluded  several  preliminary  investigative 
studies  undertaken  by  the  Deputy  Director  of  Defense  Research  and 
Engineering  (Research  and  Technology)  and  accomplished  during  the  pre¬ 
vious  year,  partly  under  contract  with  private  industry'  and  partly 
in-house'.  The  pilot  studies  had  demonstrated  that  at  least  the  first 
objective  was  reasonably  achievable  and  had  provided  Insight  with 
regard  to  more  promising  procedures. 

2.2  Strategy  and  Methodology 

The  fourfold  strategy  adopted  for  satisfying  the  objectives  was  . 
relatively  simple  in  concept  and  may  be  summarized  as  follows; 

(1)  Determine  the  extent  to  which  new  weapon  systems  are  ac¬ 
tually  dependent  upon  the  results  of  recent  advances  in  science  or  tech¬ 
nology  for  their  attained  increase  in  system  effectiveness,  decrease  in 
cost,  or  increase  in  cost-effectiveness  as  compared  to  a  predecessor 
system. 

(2)  Determine  the  proportion  of  any  new  technology,  required 
for  attaining  system  characteristics,  that  was  the  result  of  DoD- 
financed  research  in  science  or  technology. 


^■Management  Factors  Aff eating  Research  and  Exploratory  Development , 
Arthur  D.  Little,  Inc.  (Springfield,  Virginia;  Clearinghouse  for  Federal 
Scientific  and  Technical  Information,  AD  618-321,  April  1965). 

‘A  Trial  Study  of  the  Research  and  Exploratory-Development  Origins 
of  a  U capon  System — BULLPUP  (Washington,  D.C.:  Office  of  the  Director  of 
Defense  Research  and  Engineering,  15  December  I96I1). 
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Table  I 

.  PROJLC1  HINDSIGHT  WEAPON  SYSTIMS 

Designation 

Typo  of  weapon  system 

HOUND  DOG 

Air-to-Surface  Missile 

BULLPUP 

Air-to-Surface  Missile 

POLARIS  A-l 

Submarine-Launched  Ballistic  Missile 

.  .  •  V  . 

Intercontinental  Ballistic  Missile 

MINUTLMAN  I 

M1NUTFMAN  11 

Intercontinental  Ballistic  Missile 

SERGEANT 

Tactical  Ballistic  Missile 

LANCE 

Tactical  Ballistic  Missile 

Mark  46  Mod  0 

Antisubmarine  Torpedo 

Mark  46  Mod  1 

Antisubmarine  Torpedo.  ...  . 

M-102 

105mm  Howitzer 

FADAC 

Field  Artillery  Data  Computer 

AN/SPS-48 

Surveillance  and  Acquisition  Radar 

Mark  56 

Sea  Mine 

Mark  57 

Sea  Mine 

Starl ight  Scope 

Passive  Night  Vision  Device 

C-141A  ;••• 

Strategic  Transport  Aircraft 

Navigation  Satellite 

Low-Earth-Orbit  Satellite 

M-  61* 

Nuclear  Warhead,  General-Purpose  Bomb 

M-63* 

Nuclear  Warhead,  Missile 

XM-409 

152mm  HEAT-MP  Cartridge,  Ammunition  for 
SHILLELAGH  Antitank  System 

Note:  *0ata  on  these 

two  systems  are  insufficient  to  warrant  their 

inclusion  in  all  analyses. 
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(3)  Determine  s.iyni  1  iiunt  huhkjijciucii l  ,imJ  uthei  «*nvt  i  onmetit  a  I 
lactois,  ns  sih'H  by  tin*  ri**>f.n  ih  *>«,  lent  i  *»  t  or  engined  ,  1  ti.it  appear  to 
be  commensurate  with  high  u( i li/nt ion- of  lesenrrh  resitlis, 

{k}  If  the  lindinys  o!  tilt:  first  stiategy  Imliutu  a  s i yn i  I  i  — 
cant  reliance  on  new  science  or  technology,  devise  ;*  value-cost  index 
(or  set  of  Indices)  which  offers  a  quantitative  measure  of  the  return  on 
investment  in  research,  in  let  ms  of  the  enhanced  cosl-ef fectivenest,  of 
the  weapon  systems  made  possible  by  the  .purchased  knowledge . 

2.2,1  First  Strategy— Significance  of  Recent  Advances:  The  find¬ 
ings  based  on  the  first  strategy  were  a  key  to  the  entire  study.  To 
allow  making  quantitative  measures  within  the  other  strategies,  it  was 
necessary  to  establish  the  general  dependence  of  new  weapon  systems  upon 
new  science  or  technology  and,  even  more  important,  to  Identify  the 
specific  contributions  of  research  that  were  used.  The  pilot  studies 
had  defined  three  of  the  critical  factors  influencing  the  probability  of 
success  in  this  task  and  had  strongly  suggested  a  fourth. 


:r; 

*t-ii 
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The  fiiUit  ef/itVit/  facial'  was  the  recognition  that  the  contributor*, 
of  scientific  or  technological  knowledge,  particularly  at  the  more  basic 
stages,  are  infrequently  aware  of  many  eventual  applications  of  that 
knowledge.  Thus,  in  order  to  ensure  identification  of  profitable  re¬ 
search,  i t  was  necessary  to  begin  the  search  with  the  evidence  of  appli¬ 
cation  to  a  specific  weapon  system  and  then  trace  backward  in  time  the 
succession  of  contributors  to  the  knowledge  bank.  To  this  end,  13  weap¬ 
on  systems  were  selected  for  analysis  in  addition  to  the  seven  providing 
the  bases  for  the  pilot  studies.  The  total  list  of  weapons  and  weapon 
systems  is  shown  In  Table  I. 

The  criteria  for  selection  ensured  representative  samples  of  as 
many  of  the  main  categories  of  Defense  weapons  as  possible;  wherever 
practicable,  systems  having  generally  comparable  predecessors  were  chosen 
No  attempt  was  made  to  select  systems  on  the  basis  of  suspected  high 
utilization  of  new  technology. 

The  seaotid  critical  factor  Identified  in  the  pilot  study  was  the 
sensitivity  of  results  to  the  total  previous  experience  of  the  investi¬ 
gator.  In  retrospect,  the  problem  is  easily  understood.  The  investiga¬ 
tor  Is  asked  to  analyze  a  system  in  order  to  identify  the  results  of 
recent  research.  The  most  practical  and  efficient  basts  for  the  j idg- 
ments  he  must  make  is  his  own  experience.  A  young  scientist  or  engineer, 
no  matter  how  brilliant,  generally  lacks  background.  This  critical  fac¬ 
tor  and  the  fourth,  suspected  one  Were  circumvented  simultaneously.  The 
pilot  studies  had  suggested  that  there  was  reason  to  believe  a  contract 
study  group  would  find  its  efforts  impeded  by  such  matters  as  proprietors 
interests  within  the  laboratories  of  the  research  performers,  the  level 
of  its  knowledge  concerning  the  management  of  in-house  and  contract  re¬ 
search  efforts  of  the  DoD,  and  the  relatively  low  degree  of  private 
industry's  responsiveness  to  an  associate  os  compared  to  that  shown  a 
Government  agency.  The  adopted  solution  to  both  of  these  problems  was 


•* 
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iVCiflil  ‘iik 

Id  '.uni 01 

si.  lent  i 

1  i  ,  anil  1  *•*  hn  i  c  .1 1 

pi-  1  SI  Mill*  -  1  III  l  In 

Dni'.  bo  lb 

mi  1  i  lory 

.uni  c  i  vt  1 

i  .III  ,  .IS 

i  nvi-s I  i  galoi -. . 

1  or 

H  ol  1  In- 

1  1  .id.l  i  1 

i 0D.1 1  system-.  ,  ad 

Inn.  .-» 1  inly  I  t-. mis 

vi'-i  ••  ilt-siq 

n.lt  ml  by 

t  lu*  Ass  i  -.  1 

Unit  Set' 

le 1  .ii  y  (Ro  .I'.ircb  , 

anti  Di-vi- l  opliii-nl  ) 

ol  tin- 

■  Mi  l  it**  ry  Department  that  tleve  loped  llu-  wr.ipoii  .system.  Mu-  pr  i  nc  i  p.i  I 
source  of  Umiii  memhe i  s  was  I  lit*  iti-limise  laboi  a  t  or  i  i-s .  1 1 1  •  I  i  v  i.lu.i  I  *,  were 
Selected  Olid  le.lllVS  balanced  .III  ensure  I  In-  pi  e'.OIIl  e  of  flu-  lequiTed  tech¬ 
nical  experience.  Each  to .1111  was  I'ospons i I) I e  lor  llu-  study  of  urn-  -,y 
lew,  excepl  tlnit  111  two  cases  it  was  I  omul  pi.ntii.il  loi  .1  M-.iiii  Ip  study 
.1  pair  ill  sysieiiiu.  O11  1 110  average  iL  took  about  three  inniitiis  to  1  utly  ,1 
single  weapon  system,  tile  cutoff  date  be.iny  primarily  .1  fiuulion  of  I  he 
apparent  v.i I  i cl i  ( y  and  usel u t ness  of  the  sample  ol  i nfoi inn l  ion  col  lee U.-fl . 

In  response  to  the  DORsE's  request  .  the  Sand  i  a  C«ii  por.;t  ion  unde  rl  oof- 
studies  of  two  nuclear  weapon  systems.  Conceptual  I y ,  this  effort  paral¬ 
leled  the  work  of  the  D6D  in-houso  teams,  but  (lie  26  -RXU  lyehts  idenii  - 
l  ied  were  not  reported  in  as  great  cl*.* toil  as  the  pi  imary  set  ol  6M 
Events  described  by  the  Government  i lives t  iy.il ors . 

Two  system  studies  were  accomplished  by  the  very  close  involvement 
of  the  Deputy  DDR&E  (Research  arid  Technology)  [  the  Director  ol  Project 
HINDSIGHT,  and  principal  members  of  the  scientific  and  technological 
teams  that  had  developed  the  systems.  .These  weapon  systems  were  rela¬ 
tively  small  and  were  somewhat  unique  ’rr.  that  most  of  the  research  and 
development  on  both  of  them  was  done  under  the  cognizance  of  one  person. 
As  a  direct  consequence  of  the  meetings  beLween  the  Project  HINDSIGHT 
principals  and  the  performing  groups ,  utilized  scientific  and  technologi¬ 
cal  advances  were  identified.  A  professional  technical  editor  followed 
up  the  meetings  to  collect  detailed  information  on  those  RXI)  Events. 

The  other  group  studying  two  systems  was  made  up  of  scientists  and 
engineers  from  the  industrial  organizations  that  participated  as  prime 
contractors  in ‘the  development  of  the  weapon  systems.  The  anticipated 
difficulties,  as  described  in  the  introduction  to  this  report,  were  en¬ 
countered.  It  appears  to  be  reasonably  well  cstabl ished  that  this  type 
of  study  must  be  made  by  DoD  in-house  people,  either  ad  hoc  teams  or 
assigned  personnel;  each  of  these  alternatives  offers  some  obvious  ad¬ 
vantages  .  • 

The  third  and  final  critical  factor  was  the  operational  definition 
of  a  discrete  scientific  or  technological  advance. ,  The  definition  had 
to  be  used  by  a  number  of  independently  operating  investigators  with 
some  assurance  that  each,  upon  Identifying  the  same  advance,  would  de¬ 
velop  a  mutual ly  corresponding  description.  Because  the  advance  identi¬ 
fied  would  eventually  serve  as  the  basis  for  management  studies,  It  was 
desirable  that  the  activity  described  be  of  sufficiently  short  duration 
that  a  single  manager  or  fiscal  policy  would  be  involved  and  the  research 
performers  would  be'  readily  identifiable. 
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h>  these  fiul'i ,  (In*  KXP  I  vein  wh  v,  tab  1 i shed.  II  i  *,  defined  ,i>,  I  In- 

.iHiUmiM*  .it  ,i  inivi'I  idea  «ind  (In*  subsequent  pel  lull  ul  .iitiyity  tluiirii| 
which  tin*  idea  was  sub  jei  i i'il  to  In i  I  i ,i I  exumiiMl  ton  oi  '  test-.  Ifn*  KXI) 
tvetH  dillns  I  rein. utherwise  yimi  l.tr  hum.  in  endisivot  s,  sol*- ly  in  llt.il  (In* 
testing  m  examinal  inn  is  piim.itily  .1  stu*nlifi«  oi  technolog  i  cii  I  explo- 
i.iiinn,  A  mo  IV  detailed  ili*l  i »- i  l  ion  id  I  he  ItXD  l  vent  is  given  in  Appeti  - 
tli.s  1$,  which  ,ihu  il«* lines  "inter Tact*  activity,"  the  process  by  which 
knowledge  tienei.it  eil  in  .in  KX 11  I  vent  is  t  runs!  erred  I  ruin  the  lit  .  t 
innovator  to  the  second — ,iml  so  to  i  I  s  HI  i  I  i/.it  fun. 

f.nli  team  began  its  sttuly  by  examining  system  documental  i  on,  alia- 
ly.'ing  system  design  ami  details  ol  liiajur  component  s  and  subcomponent*. , 
and  discussing  technical  matters  with  the  weapon-system  development  en¬ 
gineers  to  obtain  clues  to  the  possible  use  ol  now  science  or  technology, 
bach  clue  then  became  a  trace  initiator;  and,  lo  the  greatest  extent 
possible,  the  current  user  of  the  item  was  asked  to  identify  his  source 
document  or  individual.  Then  the  source  was  interviewed  fin  the  same- 
information,  and  the  process  Was  repealed  uni i 1  the  historical  trace  ol 
the  central  concept  terminated  with  the  discovery  of  tin*  originaior(s) . 
Upon  the  location  of  the  initially  responsible  person,  the  period  of  the 
KXI)  Event  Was  defined,  and  the  required  information  was  collected  and 
displayed  as  shown  io  Appendix  C. 

To  minimize  the  reporting  ioacf  on  the  investigators,  ensure  an  even 
writing  quality,  andprovide  a  check  on  the  relative  completeness  of 
detail  in  each  Event  description,  a  single  technical-editing  service  was 
established,  The  technical  editor  was  also  responsible  for  converting 
quantifiable  information  to  a  punehed-card  formal,  which  facilitated 
data  processing,  and  for  collecting  biographical  rgsumds  from  the  people 
identified  as  participants  in  the  RXD  Events.  In  the  latter  effort,  the 
technical  editor  was  supported  and  assisted  by  members  of  the  study  teams. 

At  the  conclusion  of  its  investigation,  each  study  learn  prepared  a 
summary  report,  which  serves  two  functions:  First,  it  highlights  the 
team's  observations  regarding  management,  fiscal,  environmental  or  tech¬ 
nological  factors  that  appear  tobe  associated  with  the  conduct  or  sup¬ 
port  of  the  utilized  research  or  the  transfer  of  research  results  to 
application.  Second,  it  presents  a  crude  measure  of: -the  consequence  of 
using  new  science  or  technology  in  terms  of  increased  cost-effectiveness 
of  the  studied  system  as  compared  to  that  of  its  predecessor.  These 
reports,  whose  security  classification  varies  from  open  to  Secret,  have 
been  given  limited  distribution  within  the  DoD. 

2.2.2  Second  Strategy— Proportion  of  New  Technology  Financed  by 
the  DoD:  The  second  strategy  of  Project  HINDSIGHT  was  to  determine  the 
proportion  of  the  new  technology  on  which  new  systems  were  based  that 
was  0  result  of  DoD-financcd  research  in  science  and  technology.  The 
information  needed  for  these  analyses  was  collected  tr»  the  course  oi 
preparing  the  RXD  Event  descriptions.  In  most  cases  the  general  source 
of  financial  support  for  the  research  worker  could  be  readily  determined. 
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Table  II,  CLASS!  S  OK  RLSl ARCH  AN!)  IXPlORAIIMY  PEVLLOI’MI N1 
■  SUGGESTLl)  IN  PROJECT  IlINOSIGMl 


Science 


_ _ _ J^P  Class  ; _ 

^Investigations  in  pure  and  applied  iiiatheinatics  and 
theoretical  studies  Concerning  natural  phenomena  (R). 

Experimental  validation"  of  theory  and  accumulation 
of  data  concerning  natural  phenomena  (R). 

Combined  theoretical  and  experimental  studies  of  new 
or  unexplored  fields  of  natural  phenomena  (R). 


Development  of  a  new  material  necessary  for  the 
performance  of  a  function  (XD). 

Conception  and/or  demonstration  of  the  capability 
to  perform  a  specific  elementary  function,  using 
Technol ogy  J  new  or  untried  concepts,  principles,  techniques, 

| materials,  etc.  (XD). 

Theoretical  analysis  and/or  experimental  measurement 
of  the  characteristics  or  behavior  of  materials, 
equipment,  etc. *  as  required  for  design  (XD). 


Engineering 


First  demonstration  of  the  capability  to  perform  a 
specific  elementary  function,  using  establ i shed 
concepts,  principles,  materials,  etc.  (XD  design). 

Development  of  a  new  manufacturing,  fabrication  or 
material  s-processing technique  (XD  ihfg.)» 

First  development  of  a  complete  system  component, 
equipment  or  major  element  of  such  equipment,  using 
established  concepts,  principles,  materials,  etc.  (AD) 


Notes:  R  -  research 

XD  -  exploratory  development 
AD  -  advanced  development 


lit  relatively  few  c.ise'j ,  about  9.5  percent,  the  work  had  been  charged  to 
an  industrial  RcD  or  overhead  account  and  record*,  were  not  ova i  1  ab I e  or 
were  iruidtHjtiaie  to  def  irre  lundincj  input  to  the  account  >. .  Where  this 
occurred,  and  in  the  interests  of  etmservat ism,  it  was  arbitrarily  held 
that  the  funding  was  not  the  Dob's,  even  though  it  might  have  been  re¬ 
covered  under  AS  PR- XV  I  RtD  (i.e,  ,  the  provision  in  the  .1  « 

■  iu'tjultU  ion  governing  independent  research  and  development)  . 

2.2,3  Third  Strategy — Factors. in  the  High  Usage  of  Research 
Resu I ts:  The  third  strategy  was  to  determine  management  and  other  en¬ 
vironmental  factors  that  appear  to  be  uniquely  correctable  to  high 
utilization  of  research  results.  Based  upon  the  recognition  during  the 
pilot  studies  that  investigative  efficiency  was  extremely  sensitive  to 
the  experience  of  the  investigator,  it  was  assumed  that  a  similar  situa¬ 
tion  would  obtain  in  the.  study  of  management  factors.  For  this  reason, 
relevant  experience  was  sought  and  contract  assistance  obtained  from  two 
universities  that  have  active  management  staffs  in  their  science  depart¬ 
ments. 

The  university  people  were  asked  to  draw  upon  their  experience  for 
hypotheses  concerning  the  relationship  between  the  environment  and  the 
probability  that  research  results  would  be  used.  They  were  also  asked 
to  design  experiments  to  test  these  hypotheses,  using  the  identified  RXD 
Events  as  test  cases  for  the  experiments. 

By  October  I965,  several  hundred  RXD  Events  had  been  cataloged. 

Aboi  half  of  them  had  taken  plac"  in  a  rather  small  number  of  labora¬ 
tories  or  other  organizations,  while  the  other  half  was  spread  over  al 
most  as  many  organizations  as  there  were  Events.  In  the  interests  of 
economy  alone,  it  was  obvious  that  a  sampling  study  would  have  to  suffice 
Events  were  categorized  by  their  contributing  organization,  of  which  the 
10  most  prolific  were: 

Raytheon  Company 

Ling-1‘emco-Vought,  Inc;  ' 

Rocketdyne  Division,  North  American  Aviation,  Inc. 
Lockheed-Georgia  Company 

Pratt  &  Whitney  Aircraft  Division,  United  Aircraft  Corporation 
U.S.  Army  Missile  Command,  Redstone  Arsenal 
,  U.S.  Naval  Ordnance  Test  . Station 
U.S.  Naval  Ordnance  Laboratory,  White  Oak 
Wright  Air  Development  Center 
U.S.  Army  Munitions  Command,  Picatlnny  Arsenal 

Because  it  was  sensitive  to  the  systems  that  had  been  studied,  the 
selection  did  not  necessarily  indicate  the  relative  quality  of  the  or¬ 
ganizations;  but  it  did  provide  an  efficient  way  of  economically  maxi¬ 
mizing  the  sample  size  for  detailed  management  studies. 

In  November  1965,  these  10  organizations  were  asked  to  participate 
in  Project  HINDSIGHT  by  making  a'-ailable  a  resident  management  scientist 
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Table  III.  UNDIRECTED  Ml  SFARCI! 

1.  Observation  of  phenomena. 

2.  Formulation  of  hypothesis. 

3.  Design  of  experiment  to  test  hypothesis. 

4.  Conduct  of  experiment. 

5.  Analysis  and  interpretation  of  results 
within  the  scientist's  frame  of  reference. 

6.  Report  to  the  scientific  community. 

Table  IV.  DIRECTED  RESEARCH 

1.  Statement  of  problem. 

2.  Morphological  survey  of  available  and 
apparently  relevant  knowledge  for  a 
possible  solution,  or  deliberate  search 
for  new  knowledge  leading  to  a  proposed 
solution. 

3.  Design  of  experiment  to  test  proposal. 

4.  Conduct  of  experiment. 

5.  Analysis  and  interpretation  of  results 
within  the  frame  of  reference  of  the 
problem. 

6.  Report  to  the  "source”  of  the  problem. 


r-: 


h 


s 
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to  toiHluet  on-site  i*x|>**»  intent*,  des  i  by  ( In*  tin  i  verst  l  ie*, ,  kri  uui  se 

to  res i ili’iil  «uin*H|ei!U*itt  •>cli,nt  is t*»  was  t.tmsideiod  desirable  for  at  least 
thtee  reason*,  •  First,  tin*  individual's  know  I  edge  ot  his  utqani  val  iuti 
ami  its  people  could  save  a  considerable  amount  of  study  time.  second, 
maiuuieinetil  would  be  as  suit'd  that  piopi  ietary  interests  were  ptoteclud. 
Third,  because  the  des, iijnnted  nun  aijamen  (  scientists  would  not  be  ittito- 
duced  to  the  test  hypo theses  until  allot  the  experiments  were  conducted, 
bias  would  be  minimum.  ■ 

By  December  I965,  one  ol  the  uni versi  t  ies  had  conducted  btief 
courses  ol  instruction  to  I'ami  1  iari/e  the  resident  management  scientists 
with  study  objectives  and  the  proposed  methodology .  Distribution  of 
test  instruments  began  in  January  1966;  the  collection  and  analysis  of 
data  are  expected  to  continue  well  into  196/.  Primary  analysis  is  the 
final  responsibility  ofillie  supporting  uhiversi  I  ies.  T  he-  i  r  reports  will 
be  collected,  collated,  credited  and  published  by  the  Project  HINDSIGHT 
of  t  ice. 

2.2.1!  Four tli  Strategy — Value-Cost  Index:  The  fourth  strategy 
called  for  defining  a  value-cost  index,  or  set  of  indices,  offering  a 
quantitative  measure  of  Lite  return  on  investment  in  research.  From  the 
beginning,  this  was  recognized  as  the  most  difficult  task  undertaken  by 
Project  HINDSIGHT.  Because  the  econometrics  of  the  detailed  studies  was 
foreign  to  most  of  the  scientists  and  engineers  identifying  the  RXD 
Events,  the  conceptual  cost-value  studies  were  assigned  to  separate 
groups.  At  the  Lime  this  report  was  prepared,  however,  significant  prog¬ 
ress  had  not  been  made. 

2.2.5  Def init ion  of  Terms:  During  the  pilot  studies  it  was  dis¬ 
covered  that  the  current  OoD  definitions  of  research  (R&D  category  6.1), 
exploratory  development  (6,2)  and  advanced  development  (6.3)  were  inade¬ 
quate  for  use  in  recognizing,  classifying  or  administering  research  in 
science  or  technology.  A  more  useful  classification  scheme  (see  Table 
II)  was  gradually  developed  during  the  pilot  studies  and,  on  the  initia¬ 
tion  of  Project  HINDSIGHT,  was  adopted  without  change.  The  successful 
application  of  this  classification  system  throughout  the  studies  has 
demonstrated  its  utility. 

Although  adequate  to  provide  a  functional  description  of  the  several 
classes  of  research  in  science  and  technology,  this  categorization  did 
not  serve  as  a  vehicle  for  identifying  motivational  factors.  Further,  It 
was  obvious  almost  from  the  initial  collection  of  data  that  the  problem 
of  semantics  could  represent  a  formidable  barrier  in  the  description  of 
scientific  research  activities.  Solely  to  minimize  the  impact  of  this 
difficulty,  definitions  were  adopted  for  two  terms  used  in  this  report; 
(1)  undirected  (or  disassociated)  research  and  (2)  directed  (or  respon¬ 
sive)  research. 

The  definitions,  shown  In  Tables  111  and  IV,  are  arbitrary,  and  are 
recognized  as  describing  only  the  two  ends  of  the  spectrum.  For  purposes 
of  Project  HINDSIGHT,  however,  they  were  found  operationally  useful,  and 
so  are  used  as  a  frame  of  reference  in  the  pertinent  data  analyses. 
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3.  TML  SYSTLMS  STUDILU 


It  was  obvious  that  the  selection  of  weapon  systems  and  mi  1  i  t  ary 
equipments  for  study  under  Project  HINDSIGHT  wouid  influence  (lie  find¬ 
ings.  The  nature  and  extent  of  this  influence,  however,  could  not  be 
assessed  without  prejudging  the  eventual  findings. 

For  example,  the  greater  part  of  the  Army's  weapons  inventory: con¬ 
sists  of  relatively  ordinary  items  such  as  rifles,  howitzers,  tracked 
and  wheeled  vehicles,  radios  for  short-range  communications,  and  the 
like.  For  most  Army  operations,  these  equipments  are  at  least  as  im¬ 
portant'  as  the  more  "glamorous"  guided  missiles  and  tactical  nuclear 
warheads.  If  it  were  a  fact  that,  for  the  former  class  of  weapons,  the 
scientific  and  technological  base  came  from  the  general  civilian  economy 
and  that,  for  missiles  and  warheads,  it  was  the  result  of  military- 
supported  research,  any  undue  attention  to  either  class  in  the  HINDSIGHT 
study  would  lead  to  distorted  findings. 

In  a  similar  vein,  if  little  or  no  new  science  and  technology  were 
going  into  modern  rifles,  howitzers,  mortars,  trucks,  etc. — a  situation 
that  seemed  rather  unlikely  but  could  not  be  arbitrarily  ruled  out  be¬ 
fore  the  study  began— then  any  findings  based  on  studies  of  satellites 
and  advanced  radars  would  not  be  amenable  to  extrapolation  or  other 
statistical  inference.  To.  ensure  that  the  findings  would  be  reasonably 
valid,  HINDSIGHT  had  recourse  to  a  sampling  technique  for  system  selec¬ 
tion,  not  a  truly  random  sample,  but  a  controlled  one  to  achieve  an 
apparent  balance  of  equipment  types. 

The  weapon  systems  and  equipments  that  servfed  as  the  basis  for  this 
study  (see  Table  l)  are  briefly  described  in  the  following  pages. 

3.1  HOUND  DOG 

HOUND  DOG  is  a  jet-propelled  air-to-ground  missile  with  a  nuclear 
warhead  and  a  stellar-moni tored,  all-inertial  guidance  system.  It  is 
a. i  r- launched' from  a  pylon  beneath  the  wing  of  a  B-52  aircraft.  The  mis¬ 
sile  operates  in  either  a  high  subsonic  or  a  supersonic  mode  and  has  an 
operating  range  in  excess  of  350  nautical  miles. 

Weighing  approximately  12,000  pounds,  the  missile  has  delta  plan- 
form  wings  in  a  canard  arrangement;  the  wing  Is  located  well  aft  on  the 
fuselage  and  the  horizontal  stabilizer  is  placed  at  the  nose.  The  fuse¬ 
lage,  an  ogival  nose  faired  into  a  long  cyl indrical 'afterbody,  contains 
the  guidance  package,  the  warhead  and  all  other  subsystems,  except  that 
the  power  plant  is  suspended  far  aft  in  an  engine  nacelle  beneath  the 
fuselage. 

Development  of  HOUND  DOG  began  in  195&  and  was  essentially  complete 
in  1959. 
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3.2  BULLPUP 

BULLPUP  is  an  air-to-ground  missile,  optically  trucked  and  radio- 
comround-gu  i  tied ,  intended  for  use  against  tactical  targets  sucli  as  trains, 
bridges,  tanks,  truck  convoys,  ships  and  ground  weapon  emplacements. 

Aerodynamic  control  surfaces  are  on  the  nose  of  the  missile  (canard  con¬ 
figuration),  ami  delta  wings  provide  pritiiary  aerodynamic  lift.  This 
uncomplicated,  relatively  inexpensive  weapon  has  a  designed  maintenance- 
free  shelf  life  of  5  years  and  can  be  loaded  on  an  aircraft  in  minutes 
with  no  checkout  or  other  ground  support. 

Different  versions  of  the  BULLPUP  missile  use  either  a  solid- 
propellant  or  a  prepackaged  I iquid-propel lant  rocket  motor.  The  smaller 
BULLPUP  A  can  del  Ivor  a  250-pound  conventional  warhead  over  a  range  up 
to  approximately  6  miles  from  the  point  of  release  by  the  launching  air¬ 
craft.  The  larger  BULLPUP  B  carries  a  1000-pobnd  conventional  warhead 
over  a  range  of  some  9  miles. 

In  operation,  the  pilot  of  the  launching  aircraft  monitors  the  mis¬ 
sile  in  flight  by  radio  and  controls  its  path  by  keeping  flares  in  the 
missile's  tail  lined  up  with  the  target. 

Development  of  BULLPUP  A  was  initiated  in  1 954  and  led  to  a  first  *. 

production  run  in  early  1958.  The  first  production  contract  on  BULLPUP 
B  was  awarded  in  I960. 

3.3  POLARIS  A-1 

POLARIS  A-1  was  the  first  of  the  series  of  submarine-1 aunched, 
inertial ly  guided,  intermediate- range  ballistic  missiles.  The  A-1  was 
small  in  comparison  to  contemporary  missiles  of  equivalent  range,  could 
be  launched  from  a  submerged  submarine,  and  had  high  inherent  reliabil¬ 
ity  and  relatively  low. maintenance  requirements. 

Its  solid-propellant  rocket  motors  were  capable  of  delivering  a 
nuclear  warhead  over  ranges  well  in. excess  of  1000  nautical  miles  with 
an  accuracy  commensurate  with  the  navigational  precision  of  the  launch¬ 
ing  submarine.  ■  _  .  ,  .  - 

Despite  the  important  increase  in  combat  potential  offered  to  the 
fleet  by  the  introduction  of  POLARIS  A-1  In  I960,  the  system's  develop¬ 
ment  had  exploited  surprisingly  little  really  new  technology,  especially 
in  view  of- the  relatively  much  greater  amount  that  was  used  in  the  A~3 
version.  Undoubtedly  this  was  partially  a  consequence  of  the  A-l's  very 
tight  development  schedule,  which  allowed  no  freedom  for  long-lead-time 
efforts.  Pre-19^5  torpedo- launch  technology  was  the  chief  basis  for  the 
launch-tube  mounting  and  missile-ejection  system;  a  portion  of  the  mis¬ 
sile's  suspension,  or  shock-mitigation  system  was  developed  from  air¬ 
craft  arresting-gear  technology;  the  inertial  guidance  system,  computer 
technology  and  the  nuclear  warhead  were  no  doubt  state-of-the-art 
developments. 
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flu1  compressed  tlovc I upinen l  lime  of  tin-  POLARIS  A- 1  is  indicated  by 
the  foot  that  not  until  April  1957  wore  decision*,  made  regarding  the 
princip.il  technical  guidelines,  yel  a  POIARIS  submarine  was  at  sea  in 
June  1^60  —  a  lull  5  years  ahead  til  the  initial  target  date  sot  in  I  955- 

3.4  MINUTEMAN  I  and  II 

MINUVEMAN  is  a  3-stage,  sol  icVp  rope  Mont  ,  till  inert  ial  Vy  guided, 
intercont  inental  bal I istic  missile.  Project  HINDSIGHT  examined  :  tie 
technology  leading  first  to  MINUTEMAN  I  arid  then  to  its  successor, 
MINUTEMAN  I  I.  This  was  done  in  ah  attempt  to -gain  some  understanding  of 
how  much  new  science  and  technology  are  involved  in  the  marked  upgrading- 
of  functionally  guite  similar  systems. 

The  MINUTEMAN  missile  is  about  55  feet  long,  reaches  a  velocity  of 
over  15,000  milesper  hour  in  flight,  and  has  a  range  of  over  5000  miles. 
Motors  of  tlie  first  two  stages  are  in  metal  cases,  while  the  third- 
stage  motor,  is  encased  in  fiberglass. 

The  inertial  guidance  systehi  is  a  highly  accurate  arrangement  of 
gyroscopes  running  on  practically  frictionless  bearings. -A  digital  com¬ 
puter  contains  a  memory  section  which  stores  the  missile's  flight  pro¬ 
gram.  During  flight,  the  computer  serves  to  compare  the  achieved  flight 
profile  with  the  stored  program,  calculate  steering  Corrections  so  as  to 
maintain  the' desired  trajectory,  and  send  signals  to  the  nozzle  steering 
system  to  keep  the  missile  on  course. 

A  reentry  system  contains  the  fuzing  mechanism  and  the  nuclear 
warhead.  :  >.  ■ 

A  steel-lined  concrete  launch  tube  80  feet  deep  houses  the  missile. 
Surrounding  the  launch  tube,  under  several  feet  of  concrete,  is  a  two- 
level  equipment  room  that  is  reached  through  a  hatchway  with  a  hydrauli¬ 
cally  operated  cover.  This  room  contains  systems  for  communications, 
launch  control  and  monitoring,  and  electric-power  conversion  and  dis¬ 
tribution.  Additional  equipment  required  for  normal  operation  of  the 
launcher  is  installed  in  a  launch-support  building  a  short  distance  away. 

3.5  SERG  EANT 

This  tactical  Army  missi 1e  can  carry  either  a  conventional  high- 
explosive  or  a  nuclear  warhead  up  to  a  maximum  range  of  approximately 
75  miles.  The  35-foot  solid-propellant  missile  is  fired  from  a  mobile 
.launcher  and  is  inertially  guided  to  the  target.  Because  of  i ts  high 
thrust-to-weight  ratio,  SERGEANT  requires  no  booster. 

For  mobility  in  the  field,  the  SERGEANT  missile  is  transported  in 
sections  on  conventional  Army  trucks  that  have  been  slightly  modified  to 
accommodate  the  system.  The  warhead  is  carried  in  its  own  van,  and  the 
motor,  guidance  and  stabi 1 ization-f in  sections  are  moved  on  a  semitrailer 
When  a  missile  is  to  be  fired,  a  suitable  launching  site  is  selected  and 
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the  principal  vehicle;,  .ire  driven  into  position.  implacemurtt  ,  niivcilc- 
assembly,  checkout  ami  preparation  for  firing  can  be*  completed  In  u 
matter  of  minutes. 

Development  %»f  SERGEANT  began  in  19 66,  and  pi  oduc t  i on  commenceil  in 
i960.  It  was  oik*  of  the  first  system*,  to  employ  a  modular  design  con¬ 
cept.  When  a  malfunction  is  detected  during  checkout,  the  failed  compo¬ 
nent  is  simply  unplugged  and  a  replacement  assembly  inserted. 

3.6  LANCE  .. 

LANCE,  another  tactical  Army  missile  system,  is  being  developed  as 
an  aril  1 1 ery-guided  weapon  to  support  the  field  army  division.  This 
3200-pound  .mi ss i le  is  intended  to  carry  a  nuclear,  conventional  high- 
explosive  or  chemical  warhead  over  a  considerably  shorter  range  than 
SERGEANT'S  75  mi les.  .  ,  . 

The  propulsion  system  uses  prepackaged  storable  hypergolic  liquid 
propel  1  ant ,  which  enables  the  same  instant  readiness  provided  by  solid 
fuel,  but  also  offers  simplified  variable  boost  and  thrust  termination 
for  improved  accuracy.  LANCE  is  guided  by  a  unique  inertial  reference 
and  automatic  meteorological  correction  scheme.  The  missile  is  direc¬ 
tionally  controlled  by  steering  the  rocket  exhaust. 

The  LANCE  missile  is  about  20  feet  long,  and  its  cylindrical  body 
is  about  22  inches  in  diameter.  It  is  stabilized  by  cruciform  clipped 
delta  fins  with  an  overall  span  of  about  4  feet. 

Among  other  components  of  the  LANCE  system  are  a  self-propelled 
launcher,  convertible  to  a  lightweight  towed  launcher,  and  a  self- 
propelled  missile  transporter-loader.  With  this  equipment,  LANCE  will 
have  cross-country  mobility 'and  will  be  deliverable  by  fixed-  or 
rotary-wing  aircraft  and  by  parachute  as  well. 

3.7  Torpedoes  Hark  66  Hod  0  and  Hark  46  Mod  1 

These  torpedoes  are  antisubmarine  weapons  designed  to  attack  tar¬ 
gets  at  all  operational  depths.  About  9  feet  long  and  slightly  over  a 
foot  in  diameter,  both  torpedoes  can  be  delivered  by  either  aircraft  or 
surface  vessels.  They  have  essentially  the  same  self-contained  guidance 
system,  which  enables  the  torpedo  to  locate  and  attack  targets  within 
its  search  volume  with  no  external  assistance.  Warheads  in  both- cases 
are  conventional  high  explosive.  . 

Primary  technical  differences  in  the  torpedoes  are  found  in  their 
engines  and  steering  concepts.  The  Mod  0  uses  a  solid-propellant  fuel 
to  drive  a  hot-gas  engine;  the  Mod  1  has  a  1 iqui d-monopropel lant  cam- 
engine  propulsion  system.  Control  in  the  pitch  and  yaw  planes  for  the 
Mod  0  torpedo  is  achieved  by  tilting  a  shroud  ring  that  encompasses  the 
counterrotating  propellers,  Roll  control  is  provided  by  fin  tabs.  The 
Mod  1  uses  movable  fins  for  control  In  all  planes. 
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Development  of  the  Mod  0  was  underutken  in  I9L>8,  iiml  lii'.t  di- liv¬ 
eries  to  the  fleet  wet  e  mode  in  I963.  Because  it  uses  fiuny  of  the  proven 
components  of  the, Mod  0,  tire  Mod  I  development,  which  started  in  I96j, 
was  completed  in  ohoiit  2  years. 

3-8  1 05mm  Howi t zu r  M- 1 02 

This  howitzer  was  designed  for  the  role  of  a  convent iona I  I  ight 
artillery  piece,  although  many  of  its  characteristics  are  unconventional. 
Most  art  i  1 1 ery  pieces ,  once  emplaced  in  firing  position,  have  a  limited 
ability  to  traverse  in  azimuth  (typically  on  the  order  of  60  degrees) 
but  the  M-102  can  traverse  a  full  360  degrees.  In  addition,  improved 
steel s  were  used  in  the  construction  of  barrel  and  breech,  which  permits 
higher  internal  pressure  and  thus  a  considerably  greater  range  than  its 
1 05mm  predecessors. 

In  spite  of  these  advances,  the  weight  of  the  entire  howitzer  was 
kept  low  enough  to  permit  transporting  it  by  helicopter. 

Early  models  of  the  M-102  were  made  available  to  the  Army  in  1962. 

3.9  FADAC 

The  f iel d  art i l lery  data  computer  (FADAC)  is  a  general-purpose 
digital  computer  that  has  been  designed  and  tailored  to  assist  the 
artilleryman  in  the.  solution  of  fire-control  and  survey  problems. 

Classified  by  the  Army  as  a  standard  equipment  in  1961,  this  com¬ 
puter  can  be  used  with  all  classes  of  artillery  and  a  number  of  the 
Army's  missiles,  including  LANCE. 

FADAC  is  about  12  Inches  high,  27  inches  wide  and  about  30  inches 
deep,  and  weighs  approximately  1 90  pounds.  Despite  its  small  size,  the 
magnetic-disk  primary  memory  unit  has  a  capacity  of  8)92  words. 

3.10  AN/SPS-^8  Radar  d 

This  system  represents  an  answer  to  the  current  fleet  requirement 
for  a  practical  "3-D"  radar  capable  of  simultaneously  performing  multiple 
functions,  such  as, air  surveillance,  control  of  aircraft  intercept,  tar¬ 
get  designation  for  weapon-control  systems,  and  provision  of  information 
for  use  in  evaluating  the  air  battle.  Earlier  radars  were  limited  to 
providing  information  in  only  t.  o  of  the  three  coordi nates— azimuth, 
elevation  and  range;  the  designation  "3-D"  indicates  the  added  tjnree- 
dimensional  capability  of  this  new  radar. 


The  antenna  of  the  AN/SPS-1*8  is  mechanically  rotated  in  the  hori¬ 
zontal  plane  to  acquire  azimuth  information.  A  9-penci 1-beam  pattern  in 
the  vertical  plane,  with  electronic  switching,  provides  elevation  data. 
The  radiating  elements  are  windowed  slots  in  the  transverse  wave  guides 
making  up  the  planar  array  antenna.  The  array  is  ehd-fed  by  a  serpen- 
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The  railu  i  was  ill's  itjiuul  primarily  for  insl  <il  lot  ion  on  guidcd-mivsi  Ik 
frigates  ami  destroyers.  It  is  computer  stabilized  to  remove  perturba¬ 
tions  in  data  arising  from  ship's  pitch  and  roll. 

The  Navy 1  S  .-development  of  the  SPS-48  began  in  the  eat  ly  1960s,  A 
production  model  was  installed  in  the  USS  WOKDEN  during  the  first  half 
of  1965. 

3.11  Hines  Mark  56  and  57 

The  Mark  56  is  an  aircraft-laid  moored  mine  in  the  2000-pound  class 
designed  for  employment  against  submarines.  The  Mark  57  mine  is  its 
submarine-laid  counterpart.  Both  use  conventional  high-explosive  war¬ 
heads. 

Conceptually,  these  weapons  arc  not  significantly  different  from 
their  predecessors  of  World  War  If,  Because  of  advanced  design  details, 
new  materials  and  recent  technological  developments,  however,  they  offer 
considerably  Increased  lethality,  sensitivity  and  resistance  to  counter¬ 
measures,  the  ability  to  operate  at  much  greater  depths,  increased  shock 
resistance  to  airdrop,  and  much  greater  overall  reliability. 

The  major  differences  in  the  two  mines  lie  in  their  markedly  indi¬ 
vidual  means  of  deployment— the  Mark  56  from  the  wing  of  a  high-perform¬ 
ance  aircraft,  the  Mark  57  from  a  submarine's  torpedo  tube. 

The  current  version  of  the  Mark  56  mine  was  released  to  production 
in  1963;  production  of  the  Mark  57  started  3  years  earl ier,  in  I960. 

3,1-2.  Starlight  Scope 

The  Army's  Starlight  Scope  is  a  night-vision  device  that  can  be 
either  hand-held  or  mounted  on  a  tripod  for  use  in  observation  and  sur¬ 
veillance  when  It  is  too  dark  to  see  with  the  naked  eye.  the  instrument, 
which  looks  much  like  a  telescope  or  a  rifle  scope,  can  also  be  mounted 
on  weapons  to  enable  aiming  at  night. 

This  passive  device  employs  the  principle  of  image  intensification 
to  raise  the  light  level  in  the  viewed  scene  above  the  human  eye's  level 
of  sensitivity,  it  was  released  to  field  use  In  1965. 

3.13  Strategic  Transport  Aircraft  C-141A 

The  C-141,  a  4-jet-engine  aircraft  with  a  crew  of  8  men,  was  de¬ 
signed  to  airlift  alt  the  military  services'  combat  or  support  units  and 
(military  supplies,  delivering  them  by  landing  or  by  parachute,  as  re¬ 
quired.  it  can  carry  154  soldiers  with  their  individual  equipment  or 
80  litter  patients  and  8  attendants.  Alternatively,  it  can  carry  about 
a  31-ton  payload  over  4000  nautical  miles  at  an  average  speed  of  422 
knots. 
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The  aircraft  is  14b  It-ei  long,  has  <i  winy  span  of  jppi  oxim.it  e  1  y 
160  foot  ami  a  maximum  height  of  almost  40  fuel.  Its  service  ceiling  i! 
over  46,000  feet.  Maximum  speed  at  ah  altitude  ol  ?5,000  I eel  is  a hoot 
500  knots . 

The  letter  contract  authori-fing  the  development  of  the  C-I4IA  was 
dated  April  1961,  and  the  aircraft  saw  its  first  service  in  October 
1964.  A  unique  aspect  of  its  development  was  that  the:  initial  contract 
required  the  aircraft  to  be  certifiable  by  the  Federal  Aviation  Agency 
for  commercial  use  in  addition  to  satisfying  mi  I i tary  requirements. 

3.14  Navigation  Satellite 

This  artificial  satellite,  launched  into  a  low  earth  orbit,  makes 
it  possible  to  determine  a  ship's  position  accurately  regardless  of 
weather  or  the  anomalies' of  low-  and  medium- frequency  radio  propagation. 

By  monitoring  the  Doppler  shift  in  the  ultra-high-frequency  signal 
emitted  by  the  satellite,  the  navigator  can  determine  the  instant  of  the 
Satellite’s  closest  approach  to  his  location  and  the  slant  range  between 
the  two  points.  Using  t ime-feference  information  in  the  radiated  signal 
and  published  data  on  the  satellite's  orbital  parameters,  he  can  compute 
his  position  precisely. 

The  concept  of  a  navigation  satellite  appears  to  have  been  consid¬ 
ered  seriously  in  late  1957  or  early  1958.  In  September  1963,  a  satel¬ 

lite  was  actually  used  in  ship  navigation.  The  first  truly  operational 
navigation  satellite  was  placed  in  orbit  on  6  December  1963,  providing 
the  U.S.  Navy  with  the  most  reliable,  precise  all-weather  global  navi¬ 
gation  system  ever  developed. 

3.15  Nuclear  Warheads  M-61  and  M-63 

These  nuclear  warheads,  now  being  introduced  into  the  weapons 
inventory,  are  advanced  versions  in  comparison  to  their  predecessors. 
They  use  nuclear  material  more  efficiently,  have  Improved  structural  and 
mechanical  features,  and  possess  greater  adaptability  to  design  con¬ 
straints  imposed  by  the  weapon-delivery  system. 

Because  of  security  restrictions,  the  warheads  cannot  be  more  com¬ 
pletely  described  here;  those  considerations  also  preclude  subjecting 
them  to  the  same  type  of  study  as  that  adop'^d  for  the  other  weapon  sys¬ 
tems  surveyed  under  this  Project. 

The  study  of  the  M-61  and  M-63  nuclear  warheads  was  limited  to  a 
sampling  of  RXD  Events  that  the  study  team  believed  to  be  generally 
typical  of  advances  in  the  non-nuclear  components  of  nuclear  warheads. 
The  samples  were  small  and  contained  less  detail  than  those  of  the  other 
18  systems  studied. 


The  Sheridan  Is  a  new  armored  reconnaissance  vehicle  developed  by 
the  Army  to  replace  the  post  World  Wdr  il  light  tank.  Its  main  armament 
features  a  152mni  gun-launcher  that'  fires  either  the  highly  accurate  anti¬ 
tank  SHILLELAGH  guided  miss i le  or  a  relatively  unconventional  ar+H-lery 
projectile.  The  complete  artillery  round  of  which  that  project  1  It*  is  a 
part  is  the  152mm  HEAT  (high-explosive  antitank)  HP  (multipurpose)  car¬ 
tridge  XH-409.  The  "HP'1  designation  means  that  the  amniuni  t  ion  can  defeat 
both  hard  and  soft  targets. 

The  cartridge  case,  which  is  completely  consumed  within  the  gun 
barrel  when  the  round  is  fired,  is  a  two-piece  assembly,  manufactured  by 
a  felting  process  from  nitrocellulose  and  Kraft  fibers  with  a  resin 
binder.  ,  The  projectile  consists  of  a  one-piece  forged-steel  body  which 
is  loaded  with  approximately  6.5  pounds  of  Composition  B.  The  high- 
explosive  charge  is  shaped  so  as  to  provide,  on  being  fired,  an  extreme¬ 
ly  intense  focused  jet  of  energy;  this  represents  the  weapon's  antitank 
kill  mechanism.  Fragmentation  of  the  projectile's  steel  body  provides 
the  capability  for  defeat  of  soft  targets. 
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I  hf  yeiu'iul  objectives  uiul  strategies  i>l  Pm  jet.  I  11 1  HUS  I  CM  I  were 
desc  r  i  bed  in  section  2,  »m<!  some  uddi  I  hunt  I  specilic  question',  to  wliicli 
llu*  study  wiis  oilii  i  essed  were  set  foith  in  I  he  irtl  induct  ion.  !!»•  findings 
of"  this  Project,  in  terms  of  those  general  objectives,  s!  i  at  eg  i  olid 
spec  if  it  questions,  ore  presented  in  this  section. 

flte  study  opproocli  adopted  toi  Project  HINDSIGHT  is  sutli  that,  in 
the  purist's  sense,  the  findinys  frequent  ly  are  indicative  rather  than 
conclusive.  This  acknowledgment  in  no  way  weakens  the  significance  <;1 
the  findinys,  but  recognizes  only  that  the  complexity  of  the  processes 
studied  is. so  yreat  as  to  preclude  an  exhaustive  understanding.  More 
specifically,  it  concedes  that  a  great  variety  of  management  patterns 
have  been  shown,  by  at  leasL  one  example,  to  be  workable.  Nevertheless, 
the  HINDSIGHT  data  indicate  t ha l' some  patterns,  by  the  frequency  of 
the i r  appearance,  are  more  likely  to  be  associated  with  research  efforts 
whose  results  are  utilized. 

Whenever  possible*  data  are  presented  as  time-dependent  distribu¬ 
tions,  or  as  percentages  of  a  total,  to  afford  an  estimate  of  Lhe  rela¬ 
tive  degree  of  confidence  that  may  be  assigned  to  the  val idity  of  the 
indication  or  finding. 

In  some  cases,  interpretation  of  findings  was  found  to  be  extremely 
sensitive,  either  to  the  precis  ion  wi Lh  which  certain  words  are  defined 
or  to  the  manner  in  which  those  words  arc  used.  This  problem  was  en¬ 
countered  early  in  the  study,  and  operationally  useful  definitions  were 
invented  or  adopted.  As  pointed  out  in  section  2,  the  most  sensitive 
areas  involved—  .. 

.  the  general  classification  scheme  for  RXD  Events  and 

.  the  delineation  of  basic  research  in  science  undertaken  to 
satisfy  the  curiosity  of  the  scientist,  as  distinguished  from  that  under 
taken  for  more  pragmatic  reasons.  '  '  . 

Classifying  the  sources  of  new  scientific  or  technological  knowl¬ 
edge  in  terms  of  organizational  type — DoD  laboratories,  universities, 
industries — presented  no  especial  problem,  except  that  it  failed  to 
provide  insight  into  the  motivation  of  the  performers.  To  overcome  this 
weakness,  an  additional  classification  scheme  was  adopted  which  divides 
ail  research  Into  two  categories.  One,  referred  to  in  this  report  as 
undirected  (or  disassociated)  research,  is  conceptually  described  in 
Table  III;  and  the  other,  termed  directed  (or  responsive)  research,  is 
described  in  Table  IV.  These  definitions,  or  categorizations,  provide  a 
frame  of  reference  for  pertinent  analyses  and  discussions. 
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systems  are  actually  dependent  upon  the 
M",ullv  ol  re. •rut  tic’eiinct-s  in  sti  elite  or 
technology  for  their  dt  luincd  increase  in 
system  effectiveness,  Joe  roost?  in  uni  , 
or  increase  in  cost-effectiveness  «r. 
compared  to  .3  predecessor  system. 

<1.1.1  Finding;  Marki'dly  u>rupun  sys! i -ms  reisull  nim, 

.*-:•!  if:  i  /  ,'■!/  c.mh:  ni ng  a  eonsiileral'lc  >u<mh,  of  sci  cut.  i  fir  an.  I  Icchuultjgi- 

A  very  early  observation  of  the  Project  HINDSIGHT  study  was  that, 
almost  without  exception,  no  single  identified  RXD  Event  or  combination 
of  a  very  few  Events  is  responsible  for  an  appreciable  portion  of  a  total 
advanced  capability.  It  is  most  unlikely  that  the  observation  would  hold 
true  throughout  a  study  of  the  first  atomic-fission  bomb,  wherein  a  rel¬ 
atively  small  number  of  very  Significant  Events  involving  Einstein,  Fermi 
and  a  few  other  physicists  apparently  account  for  that  capability.  The 
observation,  therefore,  is  generally  limited  to  cases  in  which  the  prede¬ 
cessor  and  successor  systems  were  technologically  similar  but  unequal  in 
cost-effectivenes  ..  Even  here,  however,  there  are  apparent  exceptions, 
as  in  the  case  of  the  modern  artillery  howitzer.  This  seeming  discrep¬ 
ancy  is  treated  later  in  the  discussion  of  findings  4.1.2  and  4.1.3. 

The  time  distributions  of  the  RXD  Events,  with  regard  to  the  dates 
of  decision  to  undertake  engineering  development  of  the  particular 
weapon  systems  iri  which  the  new  science  or  technology  was  used,  form 
illuminating  patterns.  Representative  distribution  curves  are  shown  in 
Figures  I  through  II  and  are  discussed  in  subsequent  findings.1 

4.1.2  Finding:  There  is  a  high  positive  correlation  between  the 
r.sUiti\ye  soph istica tion  of  the  predecessor  and  successor  system:. — or  the 
rcLtiive  increase  in  their  effectiveness — and  the  amount-  of  new  sudcr.ec 
■  u‘  tec  biology  utilized  in  the  successor. 

The  argument  for  this  finding  requires  the  appreciation  of  two  back¬ 
ground  factors:  (1)  the  number  of  RXD  Events  that  would  probably  have 
been  disclosed  by  a  more  exhaustive  treatment  and  (2)  a  measure  of  the 
relative  value  of  each  Event.  ^ 

Figures  1  through  II  represent  the  RXD  Events  that  were  actually  in¬ 
vestigated  in  detaili  Estimates  of  the  percentage  of  coverage  range 
from  20  percent  for  the  C-i4iA  aircraft  to  40  percent  for  the  AN/SPS-48 
radar,  75  i  crcent  for  LANCE,  and  over  95  percent  for  the  Nark  5^  and  57 
nines.  The  spread  is  a  function  of  many  factors.  The  percentages  vary 
positively  with  the  accessibility  of  the  RXD  Event's  performers  and  with 


'Summary  desciiptions  of  these  RXD  Events  and  some  of  the  more 
relevant  data  are  given  in  Appendix  D. 


I  hi*  *>i/i*  .nwl  iti  1  itjoni  i*  ol  tht*  study  Warn  <iml ,  i  liver  si*  I  y ,  with  t  hi-  com¬ 
plexity  ol  lint  ei|U  i  pineivt  studied.  lo  the  extent  coil  1 1 1)  I  lob  1  e  ,  however, 
e.icli  sample  is  rep  reset)  tut  i  ve  ol  the  overall  type  ol  KXI)  Event  culmi¬ 
nating  in  the  specific  eipii pinent  . 

Studying  j  relatively  small  number  of  Events  that  were  sequent  ial  ly 
related  in  a  single  scientific  discipline  or  area  ol  technology  was 
generally  preferred  to  pursuing  many  tentatively  identified  Events  across 
a  broad  spectrum  of  technologies.  Thus,  there  could  be  up  to  five  times 
as  many  Events  as  have  been  counted.  The  distribution  among  the  several 
classes  of  research  and  exploratory  development,  though,  should  remain 
essentially  unchanged. 

The  second  factor,  justifying  all  contributing  Events  as  equal  in 
weight,  can  be  supported  by  a  simple  illustration.  The  transistor  is 
generally  accepted  as  one  of  the  most  important  scientific  and  techno¬ 
logical  advances  of  the  current  period.  Of  what  value  would  the  tran¬ 
sistor  be  to  an  IC8M  airborne  guidance  computer  if  the  capacitors  were 
large,  leaky,  wax- impregnated  devices?  ...if  the  inductors  and  trans¬ 
formers  used  huge  iron  cores?  ...IF  the  power  supplies  were  lead  storage 
batteries  or  i nternal -combust ion-eng ine-dri ven  generators?  ...and  if  the 
chassis  and  mechanical  support  were  fabricated  of  low-y ifeld-strength 
s  tee  1  ? 

Recognizing  the  part  that  each  advance  plays  in  this  mutually  sup¬ 
porting  effort,  one  can  conclude  pragmatically  that  all  utilized  Events 
have  essentially  equal  value  in  a  single  weapon  system.  It  is  therefore 
meaningful  to  compare  systems  simply  in  terms  of  the  number  of  Events 
required  to  achieve  their  demonstrated  performance. 

The  simplest  weapon  system  examined  was  the  M-102  105mm  howitzer. 

This  weapon  shows  an  increase  in  effectiveness  over  that  of  its  prede¬ 
cessor.  the  M-2AI ,  in  two  significant  parameters:  To  achieve  practical 
transportability  by  helicopter,  it  is  much  lighter  in  weight,  and  it  of¬ 
fers  an  approximately  40-percent  increase  in  range.  A  significant  part  of 
of  the  weight  reduction,  along  with  the  ability  to  withstand  the  higher 
internal  pressure  commensurate  with  the  extended  range.  Is  attributable 
to  a  single  RXD  Event  involving  the  production  of  better  steel  for  the 
gun  tube.  Host  of  the  remaining  weight  reduction  was  enabled  by  the  RXD 
Event  of  welding  aluminum.  A  few  additional  Events  involving  propellant 
manufacture  and  barrel-erosion  control  provided  for  the  increased  range. 
Thus,  starting  with  a  relatively  uncomplicated  system,  a  total  of  five 
to  seven  Events  resulted  in  a  markedly  improved  howitzer. 

Conversely,  for  a  somewhat  comparable  increase  in  effectiveness 
from  MINUTEMAN  I  to  HINUTEMAN  II,  some  50  technological  advances  were 
essential  (see  Figure  5).  Thus,  the  greater  the  sophistication  of  the 
predecessor,  the  more  new  science  or  technology  is  required  to  achieve 
a  useful  improvement  in  cost-effectiveness.  Where  the  predecessor 
systems  were  roughly  comparable  in  sophistication  (a  situation  that  gen¬ 
erally  existed  for  World  War  II  free-fall  bombs  and  magnet i c- i nfl  uence 
mines),  the  study's  findings  suggest  that  the  relative  increase  in 
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5.  MINUTKMAN  i  and  II  JCItM.s 


MINUTKMAN  1 
system  (IfVcIujiiiii'Hl 
<  mil  rai  l  date 


MINUTKMAN  II 

sy.sl  cm  di-vcIuiMiicn 
wiracl  dale 


r  > 


Figure  6.  BULLPUP  Missile 
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ei  loci  i  veness  of  the  suac'vsitrs  Vitrii's  directly  with  I  tie  number  oi 
utilized  RXD  Eve nts. 

lor  example,  sotntr  40  to  !>0  Events  were  required  to  achieve  an  in¬ 
crease  by  a  factor  of  about  4  between  the  free-fall  bomb  and  the  BOLLPUP 
a i  r- to- sur f ace  missile.  It  took  over  100  RXD  Events  to  increase  the 
Mark  56  mine's  effectiveness  by  a  factor  of  10  over  that  of  the  Mark  10 
mine.  In  each  case,  predecessor  and  successor  are  compared  only  with 
respect  to  roles  that  both  could  perform. 

Other  paired  examples  that  indicate  the  same  trend  can  he  cited. 

The  sample  size,  in  terms  of  number  of  systems  studied,  is  inadequate  to 
provide  a  useful  quantitative  predictor  of  the  number  of  Events  essential 
for  a  desired  increase  in  cost-effectiveness.  However,  crude  analysis  of 
the  data  suggests  that  such  a  predictor  can  be  achieved.  This  matter  is 
treated  further  in  section  7- 

4.1.3  Finding:  New  weapon  systems  ait*  mono  dependent  upon  the  new 
technology  than  on  new  science. 

Mainly,  the  systems  studied  were  of  the  post-1945  period. 

Project  HINDSIGHT  adopted  flexible  criteria  for  the  definition  of 
rew  or  recent  technology.  ’ f  the  technology  of  interest  was  used  in  a 
cruder  form  in  the  predecessor  system,  the  evolution  of  that  technology 
was  traced  back  only  as  far  as  the  time  the  predecessor  system  was  de¬ 
veloped,  general ly  after  1945.  IF  it  was  not  used  in  the  earlier  system, 
the  evolution  of  the  technology  was  traced  back  to  about  1945-  The  cri¬ 
teria  were  relaxed  somewhat  for  new  science,  accepting  some  RXD  Events 
that  occurred  as  early  as  1935.  Despite  this  double  standard,  91  percent 
of  the  710  completed  RXD  Events  are  classified  as  the  results  of  research 
in  technology,  the  remaining  9  percent,  as  the  results  of  research  in 
science. 

Further,  less  than  16  percent  of  the  technologically  oriented  RXD 
Events  were  traced  to  a  post-1935  science  base.  The  other  84  percent 
came  directly  from  the  application  of  nineteenth-century  unified  theory, 
were  the  results  of  empirical  research,  or  appeared  as  inventions  not 
needing  scientific  explanation. 

The  median  cost  of  a  DoD-funded  Event  of  a  scientific  nature  (R) 
was  approximately  $60,000;  for  a  DoD-funded  Event  of  a  technological 
nature  (XD) ,  the  median  cost  was  about  $45,000.  in  view  of  the  differ¬ 
ences  in  cost  and  the  percentage  of  RXD  Events  oriented  toward  science, 
one  possible  conclusion  is  that  a  budget  for  research  in  mathematics  and 
the  physical  sciences  should  be  about  10  percent  of  the  size  of  one  for 
research  in  weapons  technology,  where  the  classifications  shown  in  Table 
II  for  science  and  technology  (R  and  XD)  describe  the  total  package  and 
where  the  sole  objective  is  gaining  knowledge  for  application  to  weapon 
systems. 
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1  li  i mm  lu-.  ion  cannot  bo  applied  arbiu.it  ily  as  a  lost  of  cut  rent 
Dot)  fund  allocations  lor'  at  least  two  s  i  gti  i  f  leant  reasons.  -  fiist,  the 
conclusion  is  appl  icalile  only  where  t bo  work  Olforts  ale  divided  in  ac- 
coiilaiuo  with  llio  dot  in  i  t  ions  of  table  II.  The  most  cursory  cotaminat  i  on 
ol  the  Doll’s  cur  i  on  I  research,  and  exp  lore  t  ory-devo  lopimii t  pioject  struc- 
l  lire,  shows’  that  a  considerable  portion  of  i  I  s  lesoarch  ellorls  ure.ol  a 
generally  lechnoloijical  rather  than  scientific  cliai  actor .  Second,  the 
10-pet  cerrf  factor  does  not  allow  for  very  necessary  work  in  I  lie  life, 
behavioral,  social  and  other  sciences. 


4.2  Second  Strategy:  Determine  the  proportion  of  any  new 
technology,  required  for  attaining 
system  characteristics,  that  was  the  j 

result  of  UoD-financed  research  in 
science  or  technology. 

•  »  ’  ‘ 

4.2.1  finding:  W  I'oP  finaiuuxi  Uu:  majofit-y  vf  programi:  nupf'ly- 
hi/'ntV  u.*/V>i<v  ee  technology  j'ov  uatfxm-ayti turn  mjrrvwitmnt . 

Throughout  the  1945-1963  period  covered  by  this  study,  there  was 
almost  continuous  change  in  research  budgeting,  accounting  and  procure¬ 
ment  practices.  Records  have  been  retired  or  .lost ,  and  seemingly  little 
attention  has  been  paid  to  historical  accounting  for  expenditures  on  re¬ 
search  in  science  or  technology.  As  a  consequence,  no  precise  figures 

exist  ’to  describe  Do'D  or  other  investment  .in  these  areas. 

«*  ’’ 

A  useful  estimate  can  be  derived,  however,  by  noting  that  the  FY 
1966  Defense  budget  for  these  categories  of  research  is  $1.39  billion. 
Using  the  generally  accepted  understanding  that  this  investment  had  been 
growing  at  a  rate  of  8  to  10  percent  per  year,  a  total  investment  of 
$7-5  to  $10  billion  for  the  years  1945-1963  is  calculated.  A  similar 
calculation  suggests  that  non-DoD  funding  (including  industry,  state 
support  of  university  research,  and  other  Federal  agencies1  expendi-  . 
ture-.)  came  to  some.  $5-7  billion  for  the  same  period.  These  estimates 
are  given  primarily  to  demonstrate  the  absolute  and  relative  orders  of 
magnitude  of  expenditures  for  research  within  the  United  States.  (See 
Appendix  E.)  » 

For  the  710  RXD  Events  investigated  in  detail,  the  distribution  of 
funding  sources  was  as  follows: 


DoD  direct  funding-  -  --  --  --  --  --  85't 

Defense-oriented  industry  -  —  -----  92 
Commercially  oriented  industry-  -----  5?, 

Other  Government  agencies  -  --  --  --  -  >1^; 

Universities  (state  or  private  funding/  -  >)?, 

The  85  percent  directly  funded  by  the  DoD  includes  work  supported  by 
the  in-house  laboratories  of  the  Military  Departments  and  all  DoD  con¬ 
tract  and  grant-supported  work  with  any  external  organization.  It  does 


not  include  work  supported  under  the  ASPR-XV  I RtD  Program,  a  funding  pro¬ 
cedure  under  which  Defense  contractors  can  recovttr  some  self -generated 
research  expenses  as  on  overhead  cost  against  DoD  contracts;  nor  does  it 
include  work  funded  hy  industry  out  of  profits  on  DoD  contracts  and 
initiated  for  the  purpose  of  gaining  future  contracts. 

Inclusion  of  the  last-named  categories  suggests  that,  whereas  the 
DoD  only  funded  ait  estimated  55  to  65  percent  of  all  on-going  research 
in  science  and  technology,  94  percent  of  the  work  that  led  to  results 
useful  in  weapon  systems  was  in  the  class  directly  or  indirectly  funded 
by  the  DoD. 

The  principal  conclusions  that  could  be  drawn  front  this  observation 
are  that  DoD  requirements  aie  in  fact  unique  or  that  a  tremendous  dupli¬ 
cation  of  effort  was  involved.  To  a  certain  extent  the  latter  possibil¬ 
ity  is  refuted  by  the  findings  discussed  in  section  4.3  regarding 
motivation  for  utilized  research. 


V. 


\  K 


o  4-  r 

-f->  O  <L> 

a 

VI  4-»  V) 

■M  r 
c  a>  </> 
(U  uu 
>  s-  c 

UJ  UJ  3 
a.  4- 


c  x* 

o  4-  ro 
O  O  * — 
S-  •*- 

ai  P 
D-  tl  > 
0)  <d 
**  U 
o  s~  w 

*p~  d>  *o 


i/i 

P  <-> 
C  r— 

a>  <ts 

8Ufl 

°  O 

X  v« 

a:*-' 


cu 

P  <u 

«J  r— 

E  o  ^ 

•r  flj  i— 

P  r—  l/»  fd 
Wr-Of* 
Q]  (O  C  O 
>  =3  P 
*  fd  4- 
Lu 

CO  4- 

2=  O 


O  «/» 

•«-  P*—* 

P  C  r- 
3  0>  «3 

.0  4-  >  P 

-r  OUJ  O 

S-  ^P 
P  Q 
V)  X 
•r-  C£  ' 


36 


median  .'i«i  '-.y*  u:  ii\!:  Event  is  -esiienVutt  lu 
of  funding. 

\  ■  7 

Within  a  thri’e-suiiidnid-deviat  ion  limit,  itlonl  i I  ied  cos  It.  ol  UoD- 
lu ml i’J  Events  in  the  XD  category  varied  between  a  lew  hundred  doliais 
and  $‘.>80,000.  The  median  Event  cost  was  found  to  be  approximately 
$49,000.  Industrially  funded  Events  for  the  same  class  of  research 
van  it’ll  in  cost  between  a  few  hundred  dollars  and  $290,000,  with  a  median 
of  about  $33,000.  So  few  RXD  Events  were  funded  by  other  sources  that 
their  analysis  would  be  statist  ic«illy -unreliable. 

In  the  two  categories  on  whicit  useful  data  exist,  the  conclusion  can 
be  drawn  that,  although  the  DoO  can  or  will  undertake  far  more  expensive 
research  tasks  than  industry,  the  median  RXD-Event  costs  are  quite  com¬ 
parable.  -Accepting  the  estimate  that  there  is  a  difference  of  less  than 
a  factor  of  2  between  total  DoD  and  total  non-DoD  investment  in  research, 
this  finding  also  suggests  that  the  OoO  funds  a  greater  percentage  of 
low-cost  research  than  industry  does. 

*1.3  Tli  i  rd  Strategy:  Determine  significant  management  and  other 
environmental  factors,  as  seen  by  the 
research  scientist  or  engineer,  that  appear 
to  be  commensurate  with  high  utilization  of 
research  results. 

4.3.1  finding:  The  utilization  fan  tor  appears  insensitive  to 
classical  differences  in  organisational  structure  or  profit  motivation 
appearing  between  U.S.  industry,  in-house  Dob  laboratories,  and  univer¬ 
sity-associated  science  and  technology  centers.  It  may,  however,  be 
sensitive  to  differences  between  these  types  of  organisation  and  the 
vLisoic  organisational  structure  of  universities. 

Within  these  three  major  organizational  types,  the  distribution  of 
RXD  Events  was  found  to  be  that  shown  in  column  l  of  Table  V.  The  true 
measure  of  relative  productivity  of  these  three  organizational  divisions 
would  require  that  the  distribution  of  RXD  Events  be  compared  with  the 
funds  available  for  research  in  science  and  technology  in  the  same  time 
period.  While  data  of  this  type  are  not  aval lable ,  or  are  not  known  to 
exist  in  useful  form,  a  less  rigorous  measure  of  funding  correspondence 
may  be  developed.  "  . 

First,  over  91  percent  of  the  RXD  Events  can  be  described  within 
the  National  Science  Foundation's  "applied  research"  category;  NSF  esti¬ 
mates  of  DoD  fund  distribution,  by  type  of  performing  agency,  from  I9&3 
to  FY  1966  are  shown  in  column  2  of  Table  V.  A  second  measure  of  the 
distribution  of  funds  is  available  directly  from  the  data  gathered  under 
Project  HINDSIGHT.  Percentages  of  the  total  cost  of  identified  RXD 
Events  appear  in  column  3  of  Table  V — again,  classified  by  performing 
agency. 


4.2.2  I  i  ml i lur.  V'cv 
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Ilu-  most  i  mi  nt’tl  I  ,i  1 1*  ob'.rl  v.it  inn  hi  l>.-  iii.hIi-  I  i  om  l.ihlr  V  i (In'  clir.r 
i  .h  i  c  l.il  iim  between  RXD  Lvenl  oml  I  milling  <1  i  >.  t  I  i  Ini!  i  oris  loi  both  .tv.iil- 
able  onil  expended  fu.nl  per  .  ont  i  les  ,  .is  calculated  in  columns  h  ;niil  'j. 

Tin'  i. lliiis  v.iry  only  '.lightly  from  one  org.mi/al  ion  type'  to  .inotbiT, 
portly  subs  t  jn  t  i  .it  iii'.|  tin1  linding.  I  lit;  MSP  esl  i mates  lot  1963-1966  can- 
not  bo  expected  to  represent  the  diyt  l  ibut  ion  of  funds  over  the  previous 
18-ye.tr  period;  however,  they  provide  a  useful  first-order  up  pro  xim.it  iori. 

It  is  the  nature  of  research  that  dollar  amounts  convert  readily  to 
scient i f if  and  engineering  man-years,  and  this  allows  a  second  approach 
to  the  finding.  The  total  national  population  of  scientists  roughly 
quadrupled  during  the  period  from  19**5  "to  1963,  while  the  same  population 
segment  in  the  DoD  laboratories  is  believed  not  even  to  have  doubled.  If 
the  finding  is  valid,  therefore,  the  OoO  laboratories  should  show  a  gen¬ 
eral  decline  by  a  factor  of  approximately  2  in  the  pe/v-viftai/.:-  of  RXD 
Events  generated  in-house  and  an  increase  by  the  same  factor  for  the 

tif,’  number  generated.  Figure  12  displays  the  time  trend  of  DcD  in- 
house  RXD  Events,  showing  very  nearly  the  exact  results  expected. 

Available  funding  data  for  universities  do  no*  permit  an  analysis  of 
the  relative  productivity  of  two  groups  of  research  scientists  — those 
associated  primari 1 y  wi th  the  educational  portion  of  the  uni vers i ly  and 
those  assoc iated  wi th  the  scientific  and  technological  centers.  Such 
centers  as  the  Lawrence  Radiation  Laboratory  of  the  University  of  Cali¬ 
fornia,  the  Jet  Propulsion  Laboratory  of  the  California  Institute  of 
Technology,  and  the  Instrumentation  Laboratory  of  the  Massachusetts 
Insci tute  of  Technology  are  currently  receiving  an  amount  estimated  at 
less  than  25  percent  of  all  funds  for  basic  and  applied  research  going 
to  the  enti  re  .universi  ty  class— and,  of  this  ,  perhaps  60  percent  is  for 
applied  research.  Comparatively  recent  increases  it.  the  size  and  number 
of  these  groups  suggest  that  their  earlier  funding  was  even  less.  Thus, 
it  is  significant  to  find  that  75  percent  of  the.  university-credited 
RXD  Events  came  from  associated  science  and  technology  centers  or  arose 
out  of  recognizably  mission-oriented  programs. 

Within  the  correlation  accuracy  of  the  sets  of  figures  cited  and 
modified  by  the  discussions,  it  is  concluded  that  the  utilization  of 
research  results  is  essentially  insensitive  to  differences  in  classic 
organizational  structure  that  may  appear  in  U.S.  Industry,  In-house 
Defense  laboratories,  and  university-associated  science  and  technology 
centers.  The  finding  cannot  be  extended  to  include  the  educational 
portion  of  a  university. 


I  !iuljn£:  *.*»  ,i* 


U>  the  extent  pc  i  hi  i  l  tm!  hy  I  Ik-  .Rtev.ibi  1  i  ly  ol  (he  •  V**-«ii  <  !<  F*’1’ 

I,  Miller  .uni  the  validity  ol  his  recoil,  iulormol  ion  w.c,  smigli!  r«-yoi  «1iikj 
his  or  ill  i  no  1  motivation.  1  t-vs  t  luilj.  2  percent  ol  (lie  l<X|>  I  vein-,  i  ' 
tied  os  research  in  science—  that  .is  ,  less  than  oii.-holl  of  1  p<-r.  ent  ol 
the  total— appear  to  have  come  ahotil  because  the  performer  was  inter¬ 
ested  primarily  in  extending  the  bounds  of  knowledge.  In  9 »  percent  ol 
the  scientifically  oriented  Events,  the  sclent  1st  appears  fo  have  been 
motivated  chiefly  by  his  awareness  that  an  actual  problem  existed. 


For  this  particular  analysis,  a  distinction  was  made,  not  between 
basic  and  applied  research  in  science,  but  between  undirected  Iby  «*' 
agency  external  to  the  performer)  and  mission-oriented  research.  The 
criteria  for  classification  included  the  requirement  that  the  perform¬ 
ance  be  assoeiateu  with  an  identifiable  generic  problem  rather  than  some 
vague  possible  utility  of  the  result.  Thus  the  data  are  considered^ 
reasonably  representative  of  the  situation. 


The  distribution  within  the  mission-oriented  98  percent  shows  that 
73  percent  was  funded  by  the  DoD,  19  percent  by  industry,  and  8  percent 
by  other  Federal  agencies  or  by  foreign  governments.  Within  the  73  per¬ 
cent  funded  by  the  DoD,  21  percent  of  the  work  was  done  as  part  of  an 
organized  program  at  a  university-operated  science  and  technology  center, 
12  percent  as  a  separately  funded  project  at  a  university,  and  38  percen. 
at  in-house  DoD  laboratories;  and  Lhe  remaining  29  percent  was  done  by 
industry. 

It  is  emphasized  that  the  total  sample  size  of  scientific  Events  .is 
so  small  that  the  subclass  distributions  showff  above  must  be  recognized 
as  being  only  roughly  indicative  of  the  actual  situation.  The  only  con¬ 
clusion  that  can  be  drawn  with  a  reasonable  degree  of  confidence,  there¬ 
fore,  is  that  most  research  in  science  whose  results  were  found  to  have 
been  used  in  weapon  systems  was  undertaken  as  part  of  an  organized  pro¬ 
gram.  Specifically,  most  utilized  new  scientific  information  came  from 
organized  research  programs  undertaken  in  response  to  recognized  Defense 
problems. 


It. 3. 3  Finding:  As  a  rule,  the  most  useful  role  of  science  has 
been  that  of  providing  phenomenological  explanations  to  the  engineer. 


In  all  the  systems  studied,  there  were  only  two  cases  where  recent 
research  in  science  suggested  to  the  engineering  community  a  genetically 
or  Fundamentally  different  way  of  reaching  an  objective.  Those  cases 
involved  the  introduction  of  (1)  the  transistor  and  other  solid-state 
devices  and  (2)  the  thermal  battery.  The  other  scientific  contributions 
were  markedly  similar  in  concept.  The  scientist,  by  gaining  a  reasonably 
thorough  understanding  of  a  process,  technique  or  phenomenon  used  by  an 


Olio  i  in-i-1  .  piovi.los  tin-  iii<m:i'>  Ini  i  I  quMli'l  ■  ■xploi  1 .  1 1  ion  llimugh  nn  ex 
p  I  .ln.it  i  nil  nl  llu:  inul.'i  I  y  i  IU|  si.  iont  i  I  i i  tlu-«  ti.in  i 

In  .r  ■..•iii',  this  "nit  ip  lip"  mil'  nl  i  i'Sr.11  ifi  in  it-ntf  tli- ‘.i  i  iln"  t>‘i 
p.-iionl  ill  tin*'  ‘i  ii'iit  i  I  ii  ,i  I  ly  oiiciHvd  I  vents.  Iin.nu  i  use  w.i*.  tin*  ic- 
visirch  in  sc  i  .•nee  it i  in. It'd  toward  l  In-  si.  I  nl  inn  ot  ,i  spi'ilit  problem  I  nr 
a  parii.iil.il  system.  I  nvai  i  alii  y  tin-  siienlisl  I  nuked  at  (jeini.il  problems. 
In'  inv  i  ain't',  an  invest  igrif  ion  ,u I  =  t  In*  signal  ami  nnisc  (.hurai  l  ei  is  I  i  i  s 
ol  nul  ijni  nt)  ami  returning  i.i.l.i  i  ptilst's  led  lo  llu-  rat  ,ib  I  i  slim. ml  <.l  liltei 
theory,  ami  the  engineer,  applying  that  tfieoiy,  developed  .i  greatly  im¬ 
proved  radar.. 

This  example  ulso’Jioips  define  the  tl i  1  Terence  alleged  in  l lie  immedi¬ 
ately  preceding  paragraphs.  The  fundamental  capability  of  delecting  or 
1  oral ing  a  target  with  radio  energy  was  .nut  consequence  of  recent  re¬ 
search  in  science.  The  scientist,  observing  the  radar  set  in  action, 
devised  a  means  of  improving  its  performance,  and  ill  this  regard  science- 
followed  technology .  Within  this  definition,  69  percent  of  the  research 
in  science  studied  by  Project  HINDSIGHT  served  to  provide  useful  phenom¬ 
enological  explanations  to  the  engineer. 

4.3. *i  Finding ::  ¥*/><?■■  I’-iuji hcvv  apfuyar.'i  Lo  vohj-hoavilii  on  aui.t'ir.: 

«-v. thiWii  ana  -tabu Lit'ed  naionlij'ie  ■infotmaLion  nubHr.lto-; .  in- *-•»:— 
i \-i‘.,Ti<i-;'ut,i  haiulbookf.  and  U:xi  tvj’orinici'n. 

Because  there  was  a  paucity  of  Events  specifically  oriented  toward 
science,  yet  it  was’ recognized  that  many  of  the  technologically  oriented 
Events  showed  contr i but loris  from  science,  a  deliberate  attempt  was  made 
to  reconcile  this  apparent  discrepancy  through  a  sampling  analysis.  The 
results  of  this  affort  are  best  described  by  the  following  statement: 

The  average  performer  of  the  XD  Event  demonstrated  a  high  level  of  under¬ 
standing  of,  and  general  familiarity  with,  unified  theory. 

The  initial  observation  was  that  the  engineer  usually  relies  upon 
such  scientific  knowledge  as  Maxwell’s  equations.  Ohm’s  law,  the  Nyquist 
stability  criterion,  Boyle's  laws  of  gas  dynamics;  and  Newton's  lav/s. 

It  would  appear  that  the  engineer  remembers  and  uses  algebraic  expres¬ 
sions,  general  solutions  To  differential  equations,  or  simple  graphical 
techniques  that  he  encountered  in  col'ege,  but  does  not  seem  concerned 
with  the  details  of  the  underlying  theory. 

Thus  it  is  the  form  in  which  scientific  knowledge  is  made  available 
to  the  engineer,  rather  than  other  characteristics  such  as  the  age  of  the 
knowledge,  that  is  important.  A  similar  conclusion  regarding  the  most 
useful  form  of  scientific  knowledge  is  drawn  from  an  observation  that 
the  engineer  uses,  as  typical  text  references,  the  results  of  scientific 
or  'technological  research  that  have  been  condensed  and  presented  in  cavi¬ 
ty  handled  tabular  of  graphical  form. 
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ilt'il1*  i  (  v  l  runsmi  inn ,  *»ih  .itul.ti'y  «*mi  •.*.  imi  I  i  Ini’, -tiv«l  in  I  !i*»  Sit  viHiuin 
Uvt'nl  OS/l)  .  U.  W,  CuM.’r,  ul  Wf, !  inqhuir.t*,  r  i* t  i *•»!  li»-«ivUy  on  Hi »iii. imi *•, 
handbook,  ,*>*.:  ;  ;  ••  i :  f"/.  .*•*»•«■  :"t  wlm  h 

'.unmnn  i.n-il  whu  1  was  known  about  stHuruiaiy  emission  hi  i r.nismis*. ion, 
stalling  with  tin*  work  of  l«>im«iid  in  t*)00  ami  trinii  n.il  ini)  with  ih.H  ><l 
5,  Mucker  in  ll)*i  I  — -dospi  I  »•  I  Ik'  I.hI  lli.it  Guct/f  It.i  m*,«*  I  F  was  J*f«-n  til*  *•«! 
tor  Inter  work  in  this  ,n  »*a  (IvlWft-n  l')6A  and  |()6fj). 

Similarly,  the  das  iy  iters  i*l  tin*  sir  ip- 1  ine-cnnf  igiired  i  umpuneiit  s  of 
the  'transmitter  anil  TiVi|uency  synlhos i/t*r  subsys t unis  <>l  1  h»>  AM/St*S-hd 
radar  civil  it  tin*  i>j‘  Tri-pint  e  >%**.  •»<*,%  »:,v,  pubt  Kind 

in  I9?f<,  os  having  been  one  of  their  principal  tivtiuical-infurniat  ion 
settrees.  This  handbook  brings  together,  in  a  form  useful  to  the  eng i - 
neer,  the  stale  of  the  art  of  fabricat  ion  techniques  involving  selection 
of  dielectric  and  metallic  mater  in  Is,  bonding  of  metals  to  dielectrics, 
pholoelchiny  techniques  and  packaging  of  component  assemblies.  Among 
the  designs  suggested  are  transformers,  wave-guide  and  coaxial  transi¬ 
tions,  terminations,  attenuators,  variable  timers,  detector  mounts,-  . 
power  diodes,  hybrid  rings,  directional  couplers,  fillers  and  antennas. 

In  brief,  this  designer's  guide  offers  basic  techniques  and  practical 
approaches  to  the  design,  fabrication,  measurement  and  assembly  of  the 
most  advanced  strip-line  devices  for  microwave  transmission. 

Such  observations  suggest  that  more  new  scientific  findings  would 
be  used  in  weapon  systems  if  research  managers  were  more  concerned  about 
the  form  in  which  the  new  information  is  made  available  to  engineers. 

It. 3. 5  Finding:  Most  utilized  new  technological  information  was 
geneva  ted  in  the  process  of  solving  problems  identified  in  advanced  or 
engineering  development  of  weapon  systems  or  in  advancing  the  state  of 
the  art  of  generic  technologies  commonly  associated  with  broad  classes 
of  weapon  systems. 

Motivation  of  the  performers  of  research  in  technology  can  be  clas¬ 
sified  in  three  broad  categories: 

(1)  The  objective  was  a  requirement  of  a  specific  system  or 

end- item  device;  , 

(2)  The  objective  was  to  satisfy  a  recognized  generic  techno¬ 
logical  requirement;  or 

(3)  There  was  no  identifiable  objective  other  than  the  desire 
to  forward  the  state  of  the  art. 

Events  falling  into  the  first  category  are  readily  discernible. 

Far  greater  difficulty  was  usually  encountered  in  separating  the  second 
and  third  categories.  Judgments  were  necessary  concerning  what  authority 
could  "recognize"  a  requirement,  how  to  define  a  "generic"  requirement. 
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.ai.ul  i-.ii  it  aio.t'.ui'i'  <.1  i  I)  Cl  III  l  i.il  i".  "  Ii".  i  i  ril"  linm  "i  .i|u  i  i  i-il . "  ll  i-.  suspi-t  - 
l.fil  I  h.il  this  it  i  I  i-miii.i  i.  ini  I  r  mi  I  ■■  every  iiianngiM  ul  .(  I  «■«  br.:»  I  it'l  i  *  .1 1  ii'MmiUi 
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in  I  i  ml  i  ;h|  4.1./. 

0|  .ill  UXl>  1  Vint-. ,  61  puiient  li.stl  .1  specific  sy.lt'iii  1  i'ijii  i  1 1'liii'ii  I 
.in  uli  ji'i  t  i  vi’.  IJu'  61  pen  mil  divided  into  (,i)  20  pciieiit  lh.il  h.nl  .is  tin 
ohfeiliyv  .1  1  equ  i  reinent  i".  t  .il>l  i  shed  by  one  of  Idle  we.ipon  sySI  i-iiis  slndiird 
in  I’loiv'el  HINDSIGHT  anil  (l>)  d*  I  pereeril  llial  were  ini  ended  1 1,  satisfy  .1 
1  e«|tii  i  emeiit  in  ’some  oilier  system  or  application. 

Clearly,  in  ?'/  percent  of  the  RXD  Events,  (lie  idem  i  f  i  fd  ob  jcc  t  ive 
61  the  research  effort  was  the  satisfaction  of  .1  generic  teciino logical 
retfiii  reinent  .  In  a  few  cases,  particularly  when  the  t  vent  involved  a 
1i1dleri.il  s  or  a  Tabricat  ion  process,  the  results  of  the  research  were, 
found  to  have  been  appl  ied  to  material:,  or  appl  icat  ions  oilier  than  those 
considered  by  the  research  performer,  for  example,  the  vacuum-arc- 
smelling  techniques  developed  for  titanium  and  uranium  were  applied  al¬ 
most  directly  to  steel  production,  and  the  plasma-deposit  techniques  de¬ 
veloped  for  metal  plating  found  use  in  the  depositing  of  refractory 
materials.  The  number  of  identified  examples  exhibiting  this  transfer 
characteristic,'  however,  was  not  big  enough  to  warrant  a  statistical 
breakout. 

In  the  remaining  12  percent  of  RXD  Events,  the  motivation  was: 

(1)  a  commercial  end  item, 

(2)  basic  research  or 

(3)  indeterminate  (usually  for  the  reason  described  above). 

4.3.6  Finding:  The  program  of  research  in  technology  oriented 
toward  specif  ic  typos  of  equipment  has  been  a  par ticulcadu  ‘Successful 
approach  to  generating  utilized  knowledge. 

This  finding  examines  a  noteworthy  portion  of  finding  4.3.5.  Cer¬ 
tain  projects  or  programs  supported  by  the  Military  Departments  were 
repeatedly  credited  with  having  been  the  source  of  scientific  or  techno¬ 
logical  knowledge  used  in  other  weapon  systems.  Principal  among  these 
v/cre  the  Army's  Missile  A  and  Missile  B  programs,  the  Navy's  long-range 
mine  and  RETORC  (research  torpedo  configuration)  programs,  and  the  Air 
Force's  NAVAHO  missile  program. 

The  common  characteristics  of  each  of  these  included  the  specificity 
of  the  program's  operational  goals  and  the  freedom  granted  to  performers 
to  explore  mu  1  tipi e  approaches  to  the  solution  of  problems  identified 
throughout  the  program.  Wi  th  the  exception  of  the  NAVAHO  program,  none 
was  intended  to  deliver  a  particular  operational  system  at  a  given  time. 
In  every  case  management  was  centralized,  and  apparently  was  able  to 
maintain  a  practical  degree  of  balance  among  the  diverse  scientific  dis¬ 
ciplines  and  areas  of  technology  in  which  further  work  was  necessary. 
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that  weapon  sysliMH-,  pivsVn  I  imi  i|Ui*  di*m,i»uK  upon  tin*  total  )  »*i  lino  log  i«.u  1 
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noliHjy  tU*v»*  loped  lor  n»:wn*t  t  i,t  I  pm  |>o*»«:*».  Ihi*.  (  oni  1  u*.  ion  .jqjl.i  iii%  tin* 
ypiUrs*.  ol  llu*  .if moment  imutd  prinji.ims,  •• 

«  *  ..  .  •  . 
j-  Win* iv  thf  ii|i])l  i l ii l  i on  ol  M.iiMiiv  or  technology  i*.  I iiiii  t «.**! ,  qieutur 
"•pocificity  in  defining  object  iws  i*.  essent  i«i  1 ,  Within  I  In*  tun  ml 
capjbi  I  i  I  ies  of  planning  mr  1  hods ,  1 1» i s  uppe  ir*,  to  In*  mo*,  l  readily  oecuiu- 
pl  ishoii  ihrmiylt  quant  Motive  description  of  known  "real-world"  problem*.. 
Actually,  as  well  as  in  concept,  tin*  user  of  weapon  system*,  must  estab¬ 
lish  a  dialog  with  the  scientific  and  technological  cwmiiunii  i<**,  in  vdiicli 
agreement  is  sought  concerning  the  min iwum  operational  capabi  I  i  ty  tn.it 
would  be  worth  buying  for  u  giv*n  price  and  the  maximum  operational  cap¬ 
ability  that  can  be  afforded  at  the  price  with  forecast  technology. 

When  agreement  is  reached — and  here  the  discussion  is  limited  to 
systems  that  are  well  beyond  the  contemporary  state  of  the  art — a  delib¬ 
erately  advanced  development  program  may  be  undertaken.  Detailed  designs 
of  several  potential  solutions  to  the  overall  system  problem  can  be  pre¬ 
pared.  The  designs  then  provide  the  focus  for  a  supporting  research  pro¬ 
gram.  As  long  as  the  operational  objectives  agreed  upon  at  the  outset 
are  not  compromised,  the  scientist  and  technologist  can  have  the  freedom 
of  design  flexibil I ty  to  allow  other  technological  compromises.  Alter¬ 
native  approaches  to  original  design  are  essential  in  order  to  minimize 
risk  and,  at  this  state  of  the  R&D  cycle,  are  relatively  inexpensive. 
"Metal  bending,"  or  the  commitment  to  hardware,  is  essential  only  to  the 
extent  that  interface  problems  can  be  highlighted  and  identified. 

The  value  of  focused  program  planning  in  science  and  technology  is 
most  strongly  supported  by  examination  of  the  NAVAHO  program.  Contempo¬ 
rary  guidance  and  propulsion  technologies,  to  name  just  two,  were  com¬ 
pletely  inadequate  to  provide  the  first-phase  NAVAHO  missile,  which  had 
a  minimum  range  of  300  nautical  miles.  Although  inertial ,  radio-inertial  , 
radio  and  celestial-inertial  guidance  techniques  held  promise,  no  ap¬ 
proach  guaranteed  success.  Further,  the  different  guidance  approaches 
placed  dissimilar  requirements  on  the  missi le's  flight  prof lie— anywhere 
from  essentially  constant-altitude  aerodynamic  to  fully  bail istic— which 
in  turn  established  requirements  for  considerably  different  rocket  or  jet 
engines,  none  of  which  were  within  the  state  of  the  art.  In  a  similar 
vein,  dependency variable  requirements  were  established  for  other  parts 
of  the  airframe  and  ground  support  equipment. 

The  Air  Force  approach  to  this  interplay  of  requirements  was  to 
provide  specific  but  very  generous  scientific  and  technological  objec¬ 
tives,  and  the  relevancy  of  the  science  and  technology  generated  by  the 
NAVAHO  program  to  other  Defense  problems  is  fully  attested  to  by  the 
widespread  use  of  the  new  knowledge. 
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U-iii  .nut  ve  iy  likely  in  ofln-i  system-,  mil  yd  studied  by  I*  i  ojvcl  HINlj- 
SH'itll.  Aimtiu-r  .id  vantage  ol  -i  I  ype- egiii  pinout -<>i  i  cut  oil  iiiniiagiiiK-nt  is 
iloim'n-,  l  M  t  oil  in  Figure  4  ,  ll*o  i.lii  unoloijy  ol  ! vents  leading  to  the  M .  >  i  l- 
‘>6  And  ’>-/  mines .  Clearly  tin-  teihnolijgy  was  (k-yo  loped  in  uii  orderly 
l.lyliion,-  ossen  l  ia  1  I  y  a  I  I"'  t  ho-  f  equ  i  s  i  t  o  know  I  edge  be  ing  ava i 1 ub I e  belcne 
il  was  needed  i  n  tlio  oihI  ileiii. 

Another  indicator  of  iho  value  of  focused  program  planning  in  sci¬ 
ence  anil  technology  is  provided  through  analyzing  l lit-  rot e  ol  knowledge 
accretion.  For  ttiis  purpose  the  studied  systems  were  divided  into  l  wo 
classes :  .  ..  •  . 

■  •  ■  ■  i  ■  ■ 

(1)  Those  that  went  throuyh  a  relatively  extended  preprqto- 
type  and  prototype  development  path — or,  at  least,  for  which  a  system- 
concept  approach  was  adopted  in  the  formulation  of  research  and  explo-. 
ra tory-devef opmen t  programs;  and 

(2)  Those  that  were  developed  in  an  essential ly  one-step 
process,  from  technology  base  to  final  system  configuration. 

Typical  examples  are  the  Mark  5 6  and  57  mines  (Figure  *0  for  the 
first  and  jthe  LANCE  missile  system  (Figure  3)  for  the  second. 

All  RXD  Events  associated  with  each  system  within  the  two  classes 
were  analyzed  to  determine  when  they  had  occurred,  in  terms  of  how  long 
before  or  after  the  system’s  engineering  development  began.  The  re¬ 
sulting  data  were  di splayed  as  in  Figure  13.  The  potential  advantage 
of  using  an  end-item-oriented,  systems-ana lysis  approach  in  formulating 
long-range  programs  of  science  and  technology  is  clearly  seen. 

The  title  of  Figure  13,  "Technical  Confidence  Level,"  was  chosen  to 
point  up  another -advantage  of  focused  planning.  The  RXD  Event  is  gen¬ 
erally  associated  with  a  scientific  or  technical  problem  (see  finding 
4.3.2).  Thus  Figure  13  suggests  that  there  are  typically  three  times  as 
many  unsolved  problems  at  the  start  of  engineering  development  when  the 
preceding  research  programs  in  science  and  technology  had  not  been  the 
subject  of  focused  planning,  if  it  is  assumed  that  the  probability  of 
finding  timely,  acceptable  solutions  to  these  problems  follows  a  Gaussian 
distribution,  the  relative  technical  risk  is  nqt  3:1  but  the  Naperian 
anti iogari thm  of  3,  that  is,  20:1. 

In  retrospect,  some  reasons  the  weapon-system  approach:  to  research 
planning  should  be  profitable  are  obvious.  Coupling  the  research  and 
appl ications-engineering  communities  is  the  natural  consequence  of  the 
process  rather  than  an  afterthought.  By  being  responsive  to  the  identi¬ 
fied  needs  of  the  appl i cat  ions  engineer,  the  research  community's  in¬ 
terests  are  focused  in  common  with  those  of  the  marketplace  for  research 
products. 
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Figure  13.  TECHNICAL  CONFIDENCE  LEVEL 


Percent  of  new  knowledge  utilized 


(Time  before  or  after  date  of  decision  on  engineering  development) 
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Viiih  respect  In  tho  dilemma  ol  | lie  itiimagor  of  a  trUmoloijii  ol  ■  f,  - 
so.iiih  program  who  must  di-cide  whether  or  not  a  given  project  should  In- 
unilor  taken  as  generic  research  (finding  *i .  i.  !>)  ,  i  I  appears  i  hoi  sonic 
Help  is  ol  IV i oil  by  I  lie  finding  that  iheto  is  a  very  high  correlation 
between  m  i  I  i.-atinn  ol  research  results  and  the  fact  that  the  user  had 
first  staled  the  problem.  Certainly  il  suggests  that  the  uselul  autlioi- 
ity  lor  defining  a  requirement  is,  in  most  cases,  the  applications 
engineer. 

Although  applications  engineers  suggested  the  problem  toward  which 
research  was  directed  in  over  85  percent  of  the  Events  in  technology, 
the  technical  initiative  in  proffering  the  solution  in  72  percent  of 
those  Events  came  from  the  group  performing  the  research.  In  the  re¬ 
maining  28  percent,  technical  initiative  resided  in  the  appt i cat  tons- 
engineering  group  or  was  shared  by  both  groups — or  the  information  was 
not  available.  The  dominance  of  the  cases  in  which  technical  Initiative 
was  taken  by  the  performing  group  is  so  overwhelming  and  the  data  con¬ 
cerning  the  remaining  cases  are  so  indefinite  that  further  resolution 
appears  to  be  pointless.  The  characteristics  of  the  performers  are 
considered  in  section  5. 

During  the  pilot  studies  preceding  those  of  Project  HINDSIGHT,  it 
was  noted  that  successful  performers — in  the  sense  that  they  achieved 
utilized  results— were  equally  successful  in  quickly  obtaining  necessary 
funus  and  other  capital  resources.  Because  this  quick  funding  appeared 
to  be  atypical  of  OoD  research  support,  it  was  suspected  that  the  obser¬ 
vation  was  significant;  consequently,  a  deliberate  effort  was  made  during 
the  Task  I  studies  to  gain  quantitative  information  on  funding  delays. 

The  results  of  this  effort  were  not  satisfactory.  In  very  few  cases 
was  there  such  a  delay  in  funding  that  the  performers  remembered  and 
mentioned  it — or  this  may  be  the  consequence  of  a  selective  recall 
di fficul ty . 

The  Tusk  il  study  personnel  are  continuing  to  examine  this  matter. 
Subject  to  what  would  now  constitute  a  surprising  finding  by  the  Task  II 
team,  it  should  be  concluded  that,  to  achieve  a  high  research  payoff, 
timely  accessibility  of  cap! taT  resources  is  equal  in  importance  to  the 
recognition  of  a  need  and  the  existence  of  a  source  of  ideas,  together 
with  the  communication  coupling  between  idea  generators  and  users. 


fimliiH)  h.\./  dint  lust'd  that  Hu*  t  c  li-lit  t  I  i/ul  ion  fat  lot  wo*, 
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si  i  ! bo  Hu*  lelative  tioquriKY  with  wliiih  any  of  tin*  seve ra 1  possible 
.  imwuiiiit.il  t  ions  links  art*  used  lot  indicating  requi  remeiits ,  But  the  data 
tin  present  a  pa!  loro  witli  regaid  to  communit  at  ions  in  the  opposi  ti-  ditei. 
tiuo,  Unit  is,  tin.*  passiinj  til  research  lesulty  toward  tin*  eventual  user. 

Fable  VI  shows  the  findings  in  terms  of  the  Severn  1  classes  of  re¬ 
search  or  exploratory  development  previously  described,  and  considyrs 
three  general  classes  of  communicjl ions  links:  the  informal  person-to- 
person  contact,  the  published  scientific  or  technical  report,  and  the 
professional  seminar  or  symposium. 


Table  VI.  MODES  OF  IDEA  TRANSFER 


RXD  category 

Personal 
contact  (2) 

Publication 
or  report  (1) 

Seminar  or 
symposium  (2) 

Research  (R) 

45 

53 

2 

Exploratory  development: 
XD 

64 

33 

3 

XD  (design) 

79 

21 

0 

KHMIoMfniFBlWPflfWWrli 

:  77 

23 

0 

Note:  Figures  are  percentiles  of  the  research  class  (horizontal  rows). 


Despite  the  fact  that  the  professional  meeting  embodies  seme  of  the 
characteristics  of  both  the  other  links — generally  a  published  technical 
report  is  presented,  and  there  is  at  least  an  opportunity  for  person-to- 
person  interaction — It  is  seen  to  be  the  least  often  cited.  Publication 
is  clearly  the  dominant  mode  for  the  transfer  of  scientific  information, 
with  a  transition  toward  Informal,  person-to-person  communication  as  the 
specificity  of  the  technological  information  increases. 

It  should  be  noted  that  the  data  presented  in  Table  VI  consider 
only  one  attribute  of  the  seminar  or  symposium.  The  true  worth  of  these 
meetings  is  not  measured,  principally  because  we  cannot  establish  how 
many  valuable  personal  contacts  resulted  from  encounters  at  such  meetings 

Gilmore,  Gould  and  others  studied  the  flow  channels  of  technical 
information  utilized  in  commercial  firms.  The  results  they  have  reported 
corroborate  several  of  the  findings  of  Project  HINDSIGHT.1' 


r,John  S.  Gilmore,  William  S.  Gould,  el  al..  The  cf 

*.'  ixoloju  Ac.  fulsition  in  Coaiitevcial  Pi-mo  and  the  KAu'A  I'/ohi  ;  l  fa-. 
Pro-id.!:'  fOenver,  Colorado:  Denver  Research  Institute,  NASA  CR-790,  June 
1967) . 
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Wit'll  ri  g.ini  U>  tin-  l.nqi'  Uulmic.il  mer  I  i  ny. ,  they  -.lute: 

Convent  ions  ,  conferences,  symposia,  ami  t  ratio  shows  were 
highly  ranked  channels  net  much  f'r  ! I«  i r  j\ 1  >-.-u : ' 

iv  as  lor  the  opportunity  to  meet  amt 
exchange  inlormation  with  colleagues  and  to  inspect  new 
product  displays.  Many  individuals  questioned  indicated 
that  formal  papers  presented  at  meetings  tended  mainly  to 
serve  the  interests  of  the  speaker  (by  boosting  his  status), 
and  that  {yrieat In  lo  !  nc  l  ude  •  t.-y 

J*i '» [  i  ;  *•  .’  <  *  •  i  ‘J  '  tl  infcrnhii />*//. ''  [italics  added.]' 

The  Denver  Research  Inst i Lute  group  further  reports  that: 

Textbooks  and  handbooks  tend  to  be  from  two  to  five  years 
dr  "(v'i'v  behind  the  state-of-the-art.  Nevertheless,  they 
were  one  of  the  most  important  sources  of  information  for 
problem  solving.1'  [Italics  added.] 

The  words,  "or  more,"  are  emphasized  here  because,  during  the  HINDSIGHT 
information-collecting  phase,  it  was  repeatedly  observed  that  a  substan¬ 
tial  number  of  the  most  frequently  used  text  references  were  15  or  more 
years  old . 

4.3.9'  Finding:  The  evidence  denies  the  aoimnnly  accept*}  hypoth¬ 
esis  that  relatively  feu  organizations  provide  the  majority  of  the 
utilised  new  science  and  technology. 


An  analysis  of  the  distribution  of  RXD  Events  and  their  rate  of 
production  according  to  performing  organization  reveals  two  principal 
features:  Over  half  the  identified  participating  organizations  produced 
only  one  RXD  Event,  and  over  70  percent  contributed  less  than  three.  In 
the  low-rate  mode,  the  industrial  laboratory,  was  predominant,  and  as  the 
rate  of  Event  production  increases  the  principal  organizational  contribu 
tor  shifts  steadily  to  the  in-house  DoD  laboratory. 


•  "  *'•  : 

rM 


Table  VII  illustrates  the  process  and  shows  that,  when  RXD  Events 
per  organization  reach  four  or  more,  the  DoD  laboratory  becomes  a  domi¬ 
nant  source. 

These  findings  are  entirely  commensurate  with  those  cited  earlier 
regarding  the  significant  modes  of  information  transfer,  and  they  illus¬ 
trate  the  obvious  conclusion  that  It  is  easier  to  communicate  technolog¬ 
ical  requirements  within  a  single  organization,  the  DoD  laboratory  re¬ 
sponsible  for  the  system  development,  than  to  disseminate  the  require¬ 
ments  throughout  a  widely  scattered  industrial  community. 


,  V;  ;  t'Ti-i'i. ,  p.  25- 

f’ Ihi/.i .  ,  p.  26. 
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on. investment  in  research,  in  terms  of  the  en¬ 
hanced  cost-effectiveness  of  the  weapon  systems 
mode  possible  by  the  purchased  knowledge. 

The  findings  relevant  to  this  strategy  clearly  demons l rale  the  re- 
1  lance  of  new  weapon  systems  upon  the  results  of  research  in  science  -or 
technology  to  achieve  an  improved  cost-effectiveness  ratio.  Section  / 
ot  this  report,  "Requisite  Level  of  lnvest..ient  in  Research,"  gives  some 
gross  estimates  of  the  relationship  between  the  cost  of  research  and  the 
value  received;  but  a  more  useful ,  precise,  quantitative  indicator  lor 
describing  the  effectiveness  of  investment  in  research  has  not  yet  been 
dev  I sed. 

The  studies  made  thus  far  offer  some. insight  into'  the  factors  to  be 
considered  in  an  equation  relating  cost  and  value.  The  effort  to  devise 
the  cost-value  index  {or  indices)  should  continue. 

4. ft.  1  Finding:  Multiple  user,  of  apientif If  and  Icutlvado-jlfjl  ud~ 
ihwvitiii  within  a  multiplicity  of  ocapoti  vytum  require  .citi'Jr  Uuii  uu 
vesfxmth  investment  coat  fee  apportioned  umcme  ail  Utilising  eye'ema  or 
tiuii  a  portion  of  the  total  value  added  uy  each  utitisiny  suaiem  ,*.v 
attributed  tc<  the  identified  bioent. 

A  given  RXD  Event  may  manifest  itself  one  or  more  times  in  a  single 
weapon  system,  and  it  may  contribute  to  an  increased  cost-effectiveness 
ratio  in  one  or  more  systems.  Considering  only  the  20  systems  that  pro¬ 
vide  the  data  basis  of  this  report,  at  least  20  percent  of  the  710  Events 
were  identified  through  more  than  one  system.  During  the  course  of  the 
investigations  it  was  frequently  learned  that  the  knowledge  accruina  from 
an  Event  had  been  used  in  systems  other  than  the  20  under  study,  In 
fact,  it  is  believed  that,  at  the  time  of  the  study,  over  80  percent  of 
the  RXD  Events  had  contributed  to  three  or  more  applications  aside  from 
those  in  the  study. 
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Jilin  l  ;n!iin|  w  I'.  il  i  ■  i  ir.*.i-d  pi  cv  iulr.  I  y  h.*»  i  *1  i  l  I  r  I  iv.in-  •  ■  I* 

I  in-  I  i  i  •.  I  !i.ili-i|y  ( •-«•(  |  i  mi  (|  .1 )  ,  v/liiili  involved  dr  1 1- 1  m  i  n  i  in|  i  l.i  t-slt-nl 
1.1  wt  •  i .  I :  ln‘v;  -.1  ii'iui'  t>:  1 i  i  Im.ilmty  w.i*.  f  i*i|U  i  !«•<!.  A  ;.i  ii!il  i  I  i '  ul  I  ••ill'*. 
liii.Klii.il  liv-ihii*  1 1 .  i  iin  i  nln-i  i*ii  I  v.ilui'  nllifi  I  lum  it-,  ul  ili/.il  ioi. 

-i.-ii !  i  .'in:  y.iJur,  l  lit-  r  t- 1  m  ,  in  i  mi  I  i  tK|t-ii  I  mil  mily  upon  tin-  di.*«  i  ■»  ion1.  i  o 
duvi'lnp  and  piiiiuio  (Mill  lypi*  ol  weapon  sy-lciii  lli.il  turn  Id  belief  i  I  I  mm 
lor.  new  knowledge,  !u:l  upon  I  lu*  .ili'.o  I  il  I  e  x  n*.  I  i*  Htu  liviin***.  lulio  <il  the 
I  lot-,  sy.  i  riii*.  and  their  p  i  edeiv. Mil's.  Ilii*.  sugges  ( ■>  llut  I  hi  I  e  I  <il  i  oi.'.li  i  p 
between  msl  .uiil'  .il  li  i  r.vV'l  upoi  .H  ion.i  I  c.ipnbi  I  i  I  y  in  not  I  inr.ii  o.ul  iii.iy 
in*  exponent  i.i  I  .  ni  111  t  ego  I:.  i  1 o  i  I'si'.m  h  <t>*.l'.  rising  much  imiJi  i*  rapid  I  v 
l  luiii  t  .ii:.|ii  i  I  i. !  y  .  . 

.An  iMiijii  i  iv  J I  i  y  dor  i  veil  iv  lo t  ionsh  i p  lie Iwvn  impt  ove«n.*ii!  ,  comp  I iv  i  i  / 
,i|  predocessot  equ  i  pme  1 1 L  ,  and  iv  1.1 1  i  Ve  COS  I  *  e fl  ix  f  i  vdriev;  ol  |jti.<!i- <  .c-  •-  *.ur 
and  .in  i  i".sur  i  s  -..l.llOil  in  section  /.  Till*  relevant  Curve  *.vt  Figim*  \’J} 
vonfinns  Hu*  hypiHlu"’ i  s.  ol  oxpom  iUi.il  re  Jot  iotisli  i  p . 

4.  A.  3  F  i ml inq :  tkwkrMit  iau/vu  r.ir- ; .  ••:.*’  n-tuus  ;V.** 

•’•<i'i  v  .<.•] rip; i:  i tu:  u  i>:‘  -ti *  u'iiHyi:- 


This  rinding  (also  discussed  in  relat  ionsii  i'p  to  the  first  strategy)  , 
cons ide red  wi th  the  recognized  multiple  use  of  a  given  Event,  shows  that 
only  a  gross  approach  (i.e.,  considering  the  total  cost  of  all  relevant 
research)  will  be  meaningful .  Further,  if  all  research  costs  are  to  be 
included,  the  .value- received  side  of  the  equation  must  take  into  account 
all  weapon  systems  that  use  any  part  of  the  new  science  or  technology. 
This  introduces  the  notion  that  value  must  be. computed  in  terms  of  the 
weapon-systems  mix  rather  than  a  mean  or  median  cost-effectiveness  ratio; 
and  the  problem  of  assessing  the  cost-value  relationship  in  research  be¬ 
comes  a  matter  of  operations  research,  rather  than  accounting. 

4.5  Specific  Chal lenges  Es tabl i sh  the  s i gnl f i cance  of  specific 

Regarding  DoD  questions  or  challenges  raised  by  critics 

Management:  of  the  DoD  research  p'rograms. 

The  derivation  of  such  challenges  is  described  in  the  introduction 
to  this  report.  In  this  section,  pertinent  findings  are  discussed  in 
terms  of  the  challenges,  which  again  are  presented  in  the  form  of  hypoth¬ 
eses  i "  ’ 


i 
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4 .  H .  i  First  tliu  1 1  ciHjt* ;  Tin*  DoD 1 «,  rvqu  i  rcim-nt  *,  for  informal  ion 
in  science  and  technology  can  be  satisfied  to  such  an 
extent  by  research  supported  by  tin*  National  Aeronautics 
and  Space  Administ  rut  ion  and  the  National  Sc  iern.e  Founda¬ 
tion  that  sijjni  ficaiit  reduct  ions  r:arr  be  made*  in  tin* 
applicable  portions  of  the  Defense  budget. 

F i ruling  :  '/'.*••.*  .1, nif>kint  /wt ion  of  mi*  not,  'not-  or*  «/;/ 

:uh\!  : i :  ;,v,r/v>.*  I  timt  tA tv  tho  vomit  of  tW-jV/U/.'.-v  '  [•’‘Otjiunio. 

Less  than  2  percent  of  DoD-uil I ized  research  results,  both  scien¬ 
tific  and  technological,  came  from  programs  supported  by  other  Federal 
agencies,  state  governments  and  foreign  governments.  This  is  not  sur¬ 
prising  in  the  light  of  the  finding  that  61  percent  of  the  RXD  Events 
occurred  as  the  result  of  a  specific  technological  weapon-system  require¬ 
ment,  and  that  27  percent  were  the  result  of  research  conducted  to  sat¬ 
isfy  recognised  generic  technological  requirements  of  broad  classes  of 
weapon  systems.  Of  the  remaining  12  percent  of  Events,  9  percent  were 
the  result  of  scientific  research,  most  of  which  was  oriented  toward 
Defense  problems;  and  3  percent  were  for  the  solution  of  commercial  prob- 
I  ems . 

Relatively  little  undirected  research  (as  defined  in  Table  III)  Is 
in  fact  sponsored  by  the  DoD.  The  larger  part  was  found  to  be  very 
relevant  to  mission  and  therefore  likely  to  be  of  pr i ma ry  va 1 ue  to  users 
having  quite  similar  requirements. 

During  1946,  the  starting' point  of  the  period  studied  by  Project 
HINDSIGHT,  the  Military  Departments  invested  about  $115  million  in  the 
categories  considered  here  as  RXD.  At  that  time  the  investment  by  other 
Federal  departments  was  negligible.  As  noted  In  Appendix  F,  military 
spending  increased  steadily  and  gradually  to  $1.5  billion  in  1 9&3 .  Com¬ 
paratively  significant  funding  in  these  areas  by  other  Federal  depart¬ 
ments  or  by  industry  did  not  appear  until  late  in  the  1950s.  Their 
expenditure  rates  increased  more  rapidly  than  the  DoD's,  so  that  by  19&3 
the  other  Federal  agencies  were  spending  about  $6.3  billion  on  scientific 
and  technical  investigations,  and  industry,  about  $2.1  billion.  As  a 
result,  for  the  entire  period  from  1945  to  1963,  the  DoD  spent  altogether 
about  $10  billion;  non-Defense  expenditures  for  those  years  totaled  $6 
billion. 


If  the  process  of  technological  growth  were  truly  random— that  is, 
independent  of  users'  requirements — Project  HINDSIGHT  should  have  found 
that  a  much  higher  percentage  of  RXD  Events  were  funded  by  non-Defense 
organizations.  Because  of  differences  in  starting  time  and  growth  rate 
of  the  two  funding  categories,  a  ratio  of  60  to  40  percent  would  not  be 
likely,  but  it  would  be  closer  than  the  observed  94  to  6  percent. 

This  discussion  and  the  ratios  suggested  relate  to  all  funding 
sources  other  than  DoD,  rather  than  to  the  other  Federal  agencies  alone. 
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While  il  is  ,i  ilt'i’.u  (ill  c  I  iihii  l  lie  line  inlent  o  i  (lie  liypcit  lies  i  s ,  I  lie  die 
eu ss  i  i »ii  p  1 1 >v  i  vis e  he  t  I  e r  (.nnl  *.  t  i  I  1  i  u t  e  I  I  i-i  l  iiit  I  I  y  i  oil s  i  s  ( en  l  )  lie *>  i  s 
toi  ano  I  ys  i  s  .  Il  demons  (  r.i  I  e*.  (hat  the  winds  ■■lit-im:  anil  l  et  lino  I  oqy  a  re 
convenient  or  til’ lies.  In  j  oil,  it  would  lie  mine  realistic  to  speak  ol 
the:  many  sciences  and  t  ei  linolnq  i  es  .  'I  In*  pal  I  i  cu  lot  field  <:l  siience  or 
leclnioloyy  that  is  impoi  taut  to  iiny  user  need  bear  no  simi  lai  ily  lo  tli.it 
t>t  another  user,  bill  society  for  convenience  has  adopted  those  wot  els  as 
generic  terms  to  signify  the  many  sciences  and  technologies  thus  cule- 
gorivteif. 

Thus ,  a  I  though  both  Defense  and  NASA  may  be  said  to  conduct  scien¬ 
tific  and  technical  investigations  in  .m  area  termed  rocket  propulsion, 
for  example,  it  cannot  be  concluded  that  tlveir  work  is  dupl icat ivc  ui 
even  usefully  complementary.  One  might  suspect  that ,  as  long  os  NASA  is 
interested  in  cislunar  exploration,  the  related  equipment  and  propulsion 
technologies  will  be  qu  i  te  s  inii  I  ar  to  those  associated  with  the  DoD's 
satellite  arid  ICBM  systems.  Clearly,  however,  there  will  he  a  technolog¬ 
ical  divergence  where  NASA's  interest  extends  beyond  the  cislunar  into 
regions  in  which  magnetohydrodynamic  and  ion  propulsion  systems  are 
practical.  Similar  trends  can  be  expected  in  communications  and  perhaps 
in  (Materials,  only  generic  names  remaining  in  common. 

The  conclusion  is  that  even  greatly  increased  expenditures  for 
scientific  and  technical  investigations  by  Federal  agencies  other  than 
the  DoD  are  unlikely  to  result  in  satisfying  many  Defense  needs. 

A. 5. 2  Second  challenge:  The  currently  high-level  support 
;df  basic  work  Is  producing  scientific  and  techno- 
logical  information  at  such  a  rate  that  it  cannot  be 
'  effectively  digested.  Interpreted,  disseminated  or 

put  to  practical  use.  \ 

Finding;  The  available  information  is  being  adequately 
broadcast  but  is  insufficient ,  despite  the  level  of  expenditures,  to 
satisfy  ail  requirements. 

Were  this  allegation  true  to  any  significant  extent,  there  would  be 
a  very  low  probability  that  the  result  of  any  given  research  effort 
would  have  many  uses  in  different  weapon  systems.  In  fact,  over  80  per¬ 
cent  of  the  RXD  Events  are  believed  to  have  contributed  to  three’or  more 
different  weapon  systems,  and  those  systems  generally  were  developed  by 
different  engineering  teams. 

Figure  lA  summarizes  the  time  distribution  of  the  utilized  RXD 
Events  shown  in  Figures  1  through.il.  The  data  have  been  normalized  to 
the  dates  of  system  design,  engineering  development,  or  first  production 
contract.  Approximately  33  percent  of  the  requisite  new  scientific  and 
technological  information  is  seen  to  have  been  generated  after  the  nor¬ 
malizing  date,  and  to  a  considerable  degree  was  paid  for  with  engineer¬ 
ing-development  money. 
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In  this  clKi!  lengo,  tlu-  effect  ivi'in-ss  of  the  iii.in.iguinetil  exert  i  yeti  hy 
the  OoD  over  tin-  mi  I  i  uiryfsc ioncos  budget  category  i s  que.-st  i  dried,  vi /.  : 

Improved  management  and  critical  select  ion  procedures  such 
Os  those  which  are  being  applied  to  complex  and  costly 
weapon  systems  could  well  and  profitably  be  extended  to 
the  supporting  efforts  included  in  the  "Mi  I i tary  Sciences" 

•  category 

Generally,  the  synergistic  consequence  of  hundreds  of  identifiable 
advances  is  the  basis  for  a  markedly  superior  weapon  system,  rather 
than  one,  two  or  three  important  scientific  or  technological  contribu¬ 
tions 

In  order  to  apply  a  cost-effectiveness  approach,  it  would  be  nec¬ 
essary  to  describe  fully  each  combination  of  advances  that  could  permit 
a  future  system,  and  then  compate  the  combinations.  The  task  would  be 
further  complicated  by  the  multiple-use  potential  of  the  individual  re¬ 
search  effort.  The  "shopping  lists"  for  all  considered  weapon  systems 
would  have  to  be  compared  before  the  most  "cost-effective"  research  pro¬ 
gram  could  be  determined.  It  is  suspected  that  the  expense  of  such  a 
procedure  would  exceed  the  anticipated  savings,  while  the  time  required 
would  cause  irreparable  damage  to  the  program. 

A  possible  alternative  approach  would  be  the  development  of  analyt- 
•ica'  procedures  to  aid  in  al locating  resources  among  specific  tecnnolo- 
gies  that  are , important  to  Defense.  The  feas ibi 1 i ty  of  such  an  approach 
is  suggested  by  the  finding  that  certain  technologies  appear  to  be  unique 
to  the. Dot).  It  is  reasonable  to  expect  that  the  military  services  could 
identify  and  rate  their  future  required  operational  capabilities,  that 
those  capabilities  could  be  reexpressed  in  terms  of  future  desired  mili¬ 
tary  equipments,  and  that  scientific  and  technological  advances  to  enable 
developing  those  equipments  could  be  identified.  Then,  it  should  be 
possible  to  introduce  economic  marginal-return  analyses  to  assist  in 
decisions  on  resource  allocation. 


.  V  "X. 
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Designing  suth  a  priK'tdiii  e  appears  to  In-  within  tin*  cut  rent  stale 
of  (hi*  ituHtiigemi-n  t  art.  Its  imp  lemi-nl.it  ion  would  l>«*  (|t-iu-r.j  I  I  y  njnsi  su>hl 
with  the  Project  II1NDSIGH1  findings  in  regard  to  the  selection  of  it- 
search  tasks. 

Undoubtedly,  in  an  activity  ns  large  a>.  the  DoD's  research  progiam, 
there  are  some  marginal  tasks.  At  best,  the  suggested  nuinayenien t  ap¬ 
proach  could  eliminate  some  of  them,  at  the  same  time  introducing  ,t  risk 
suggested  by  the  following  finding. - 

r.iunl't  '/•  i  <f  i>«  ;‘ij  imj'.r’  .•>:! 
fill  it  t  h.in  fotth  ■'"/■i  i\t 

The  investigation  of  a  sampling  of  the  RXD  Events  discloses  a 
fairly  common  pattern.  Both. the  producers  of  the  utilized  scientific 
effort  and  their  contemporary  peers  were  aware  of  the  avenues  of  explo¬ 
ration  that  the  others  were  taking.  The  disagreement  by  contemporary 
authority  as  to  the  merit  of  the  approach  that  eventually  found  use  was 
so  marked  that  the  successful  performer  broke  with  his  peer  group  and 
secured  new  funding.  More  than  anything  else,  these  examples  point  out 
the  necessity  for  ensuring  competition  within  bureaucracy  and  the  abso¬ 
lute  essentiality  of  maintaining  decentralized  funding  authority,  or  a 
multiplicity  of  funding  sources,  for  every  scientific  discipline  and 
area  of  technology.  The  challenge  suggests  a  diametrically  opposed  move. 

As  a  result  of  decentralized  planning  throughout  the  time  frame 
considered  by  Project  HINDSIGHT,  67  percent  of  the  requisite  new  knowl¬ 
edge  was  available  before  it  was  needed.  Since  it  is  recognized  that 
the  saving  to  the  nation  as  a  consequence  of  this  new  knowledge  exceeds 
by  orders  of  magnitude  the  total  cost  of  the  research  program  (see  sec¬ 
tion  7),  the  real  measure  of  the  effectiveness  of  research  management  is 
the  degree  to  which  new  knowledge  Is  available  when  needed. 

A . 5 •  *1  Fourth  cha  1  lenge :  Significant  portions  of  the 
Defense  research  program  may  be  operating  at  or 
near  a  point  of  marginal  returns. 

The  analysis  presented  in  this  report  Is  based  in  710  RXD  Events 
identified  by  studying  20  weapon  systems.  It  is  estimated  that  a  more 
exhaustive  study  of  only  those  systems  would  have  revealed  an  additional 
400  to  1000  Events.  The  median  cost  of  an  RXD  Event  was  $1(5,000.  An 
average  additional  cost  factor  of  15  was  found  necessary  to  carry  the 
median  Event  from  initial  demonstration  of  feasibility  to  readiness  for 
appl icat ion. 

Recognizing  the  weakness  of  these  figures  for  anything  more  than 
order-of-magni tude  estimates,  and  assuming  that  there  were  only  1000 
Events  in  all,  one  can  place  the  cost  of  the  RXD  Events  for  these  20 
systems  at  approximately  $600  million  out  of  the  estimated  total  of 
$10  billion  invested  by  the  DoD  In  research  between  1 9^5  and  1963.  The 
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M  l  In-  i  vsom  cy-,i  I  Incut  ion  pi  ocedurc  Suggested  In  t  l  it-  <1  i  nub!,  i  on 
ot  t  i  ml  i  ng  .  b .  ‘j .  > .  I  wfi  o  t  u  bo  deve  loped  odd  implemented,  subir.arg  ina  1 
reseurcn  t.i'ilv1.  could  bo  i  dent  i  f  i  oil  in  a  somewhat  less  subjective  fashion. 

hPj.W  f  if  t  h  chu  I  I  einie  :  The  support  of  scientific  research 
in  tlio  universities,  by  the  Dop  and  at  current 
funding  levels,  Siyni  f  ieanl  ly  affect  s  the  availability 
ol  the  best  faculty  talent  to  teach  students. 

Obviously,  any  activity  uniier taken  by  a  professor  other  than 
t each i  113  or  counseling  the  student  body  could  detract  from  his  primary 
work  simply  by  reducing  the  time  available  for  it.  But  it  is  generally 
agreed  that  the  professor  must  continue  to  do— or  to  di  rect  — research  in 
his  chosen-area  or  risk  having  his  seienti fic  expert ise  rapidly  diminish. 
Thus  the  real  concern  (and  this  may  be  inferred  f rom  the  chal lenge)  is 
whether  or  not  DoD-supportcd  research  activities  at  0  university  have, 
in  the  balance,  a  deleterious  effect  on  the  students. 

The  investigations  under  Project  HINDSIGHT  do  not  provide  a  direct 
and  unequivocal  answer  to  this  challenge.  But  many  of  the  findings, 
reinforced  by  conclusions  of  other  relevant  studies,7  offer  useful 
insight.  Findings  of  this  Project  that  bear  on  this  matter  (developed 
more  fully  in  section  5.3)  ate  summarized  here: 

Host  important,  the  HINOSIGHT  data  show  that  the  universities  re¬ 
ceiving  the  greatest  amount  of  DoD  funds  for  research  graduate  a  dispro- 
portionatly  high  percentage  of  the  people  who  later  produce  the  science 
and  technology  used  by  the  Departmentof  Defense.  Specifically,  the  23 
universities  responsible  for  doing  most  of  the  research  that  the  DoD 
supports  in  academic  institutions  award  only  25  percent  of  the  doctorates 
earned  in  the  United  States,  but  that  group  includes  50  percent  of  the 
Ph.D.'s  who  have  been  identified  as  important  contributors  to  RXD  Events. 
Similarly,  the  23  universities  most  heavily  supported  in  research  by  the 
DoD  award  about  11  percent  of  the  Master's  degrees  in  science  and  the 
arts  in  the  nation*  but  *l6  percent  of  the  identified  contributors  re¬ 
ceived  their  degrees  at  these  schools. 

The  findings  of  Marquis,  Allen  and  de  Sol  la  Price,8  based  on  their 
studies  of  the  postgraduate  education  of  the  country's  engineers,  are 

T  .  G  Ma: qu i s  and  T.  J.  Allen,  American  Psychologist,  2J_,  1052, 
Demi  j.  de  Sofia  Price,  "Is  Technology  Historically  Independent 
o-  science.'  fi  Study  in  Statistical  Historiography,"  Teclinclogu  a>U : 
Culture,  f,  k.  Fell  1965,  pp-  553‘5&8. 
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thoroughly  consistent  with  the  foregoing  observations,  and  clearly  sug¬ 
gest  that  the  engineer  continues  through  life  armed  primarily  with  the 
science  he  learned  as  an  undergraduate  student.  The  greater  his  profes¬ 
sors'  knowledge  of  the  state  of  the  art,  the  more  advanced  was  his 
scientific  education.  So  it  is  not  surprising  to  find  a  possitive  cor¬ 
relation  between  the  level  of  the  DoD's  support  of  a  university's  re¬ 
search  and  the  subsequent  useful  productivity  of  its  graduates. 

The  time  elapsing  between  an  engineers'  graduation  and  the  peak  of 
his  productive  work — on  the  average,  about  !0  to  15  years  — seems  to  be 
independent  of  his  scholastic  experience.  All  the  patterns  revealed  in 
this  study  suggest  that  it  is  a  function  of  the  rate  of  the  Individual's 
contact  with  actual  working  problems.  At  this  distance  from  his  last 
significant  exposure  to  science,  the  engineer  has  learned  enough  about 
typical  problems  and  their  technical  solution  that  he  can  solve  a  new 
technical  problem  on  the  basis  of  that  experience  and  his- knowledge  of 
science. 

In  brief:  All  observable  quantitative  measures  deny  that  there  is 
any  great  substance  to  the  challenge  that  DoD- supported  research  in 
universities  has  a  generally  harmful  effect  on  the  students  at  those 
i>istitutions . 
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ADD  IT  I  ON  Al  riNIUNOS 


I  ho  |»  r  i  mi  ry  il.it  a  has.-  of  Project  HINDS  Kill  I  consists  of  71.0- di  sc  rule 
Evon  l  descriptions  in  tin-  prescribed  formal  (see  Appendix  C)  and  511  do- 
mi  foil  1) i iHjr jplvica I  sketches  of  the  performers  involved.  Of  the  tvc-ril 
descriptions;  08  A  ore  complete  in  a  1 1  essential  details;  26  arc-  adequate 
to  support  only  a  portion  of  the  analyses.  The  1  indiiujs  presented  in 
sect  ton  0  u re  those  considered  most  relevant  to  the  questions  outlined  in 
sections  i  and  2  of  this  report,  hut  tlx-  analyses  on  which  they  were 
based  did  not  exhaust  the  potentials  of  the  accumulated  data. 

In  this  section  and  the  next  two,  this  information  is  considered 
further.  First,  the  data  are  displayed,  and  where  possible  correlated 
with  the  findings  of  other  reported  researches,  and  some  inferences  are 
drawn.  Sections  6  and  7  contain  additional  inferences  regarding  the 
nature  of  a  high-payoff  research  env  i  ronnlent  and  future  Defense  require¬ 
ments  for  research  funds.  : 

5.1  Qual  I  ty  of  the  Data' 

5.1.1  Uniformity;  Despite  efforts  to  maintain  uniformity  in  the 
data  base,  there  is  a  considerable  amount  of  unevenness  in  the  more  sub¬ 
jective  areas.  Problems  arose,  for  example,  in  separating  the  really 
inventive  activities  that  advanced  science  and  technology  from  more 
routine  engineering  work  barely  within  the  state  of  the  art.  Consensus 
of  the  study  teams  was  the  primary  criterion  for  screening  the  activities 
in  this  respect.  A  review  by  the  Project  Director  followed,  resulting 
in  the  rejection  of  2  to  3  percent  of  the  Events  surviving  the  first 
scrutiny.  Undoubtedly,  another  independent  review  would  have  somewhat 
different  results. 

Also  contributing  to  the  data's  lack  of  uniformity  was  the  diffi¬ 
culty  met  in  ascertaining  the  precise  terminal  point  of  an  Event.  By 
definition,  an  Event  terminated  at  the  instant  feasibility  was  first 
demonstrated  or  validity  proved.  In  practice,  Judgments  about  what  con¬ 
stituted  proof  of  validity  differed  widely.  Because  this  problem  was 
never  satisfactorily  resolved,  the  distributions  of  Event  duration  and 
cost  were  viewed  in  the  data  analysis  as  only  general  ly  ‘ indicative  of 
the  situation. 

5.1.2  Nature  of  the  Events:  Although  each  Event  was  considered 
unique,  a  preliminary  analysis  suggested  that  it  would  be  possible  to 
class'fy  most  of  the  Events  by  type  with  a  relatively  limited  set  of 
descr  ptors.  To  this  end,  15  descriptors  were  selected;  and  for  each 
Event  it  was  stated,  "This  Event  advanced  the  state  of  the  art  by  the 
application  of  _ _  to  _ for  _ _ employing  the  three  ap¬ 

propriate  descriptors  from  the  following  list. 


DESCRIPTORS  FOR  Cl.ASS  I T  Y I  Nil  IVIN  IS 

Research  New  I  lint  1  ion 

Njthcm.it  ics  I stahl i shed  luouitm 

Natural  phenomena  Manufacturing  {piutessj 

Specific  function  Equipment 

New  lochit iquc-  Analysis 

Established  technique  Design  specif icat ion 

New  material  Theoretical  validation 

Established  material 

The  consequent  distributions  were  analysed,  with  the  following 
indications: 

5. 1.2. 1  Scientific  Events:  Alvut  9  |mr«[  of  ihc  Evi.nls 
involved  discoveries  or  mivanoes  arising  from  scientific  iHi>est.igalii.hr. 

It  should  be  noted  here  that  a  very  rigorous  definition  of  “science" 
is  used  in  this  report  (see  Table  II).  For  example,  it  is  riot  synonymous 
with  the  DoD  budget  category  "research,"  although  there  is  a  useful 
degree  of  similarity.  In  interpreting  the  significance  of  the  9-percent 
figure,  however,  it  is  more  important  to  know  that,  even  though  the 
Event  occurred  in  a  university  and  the  performers  might  normally  be 
called  scientists,  if  the  nature  of  the  work  tended  more  toward  technol¬ 
ogy  than  science  the  Event  was  categorized  as  technological.  This  par¬ 
ticular  finding,  therefore,  says  nothing  about  the  relative  value  of 
scientists  vs.  engineers  or  of  an  organization's  science  and  eng <  firing 
departments. 

Recently  the  Department  of  Defense  budget  for  research  has  been 
roughly  one-third  the  size  of  the  one  for  exploratory  development.  If 
there  is  any  relationship  between  a  program's  size  and  the  number  of 
utilized  results,  the  9-  to  91-percent  ratio  of  scientific  to  technolog¬ 
ical  Events—rather  than  the  logical  1:3  ratio  suggests  that,  in  prac¬ 
tice,  a  considerable  portion  of  the  work  funded  by  the  DoD  as  research 
is  in  fact  technology,  not  science. 

5.1. 2. 2  Materials:  The  development  or  application  of  new 
materials  was  the  sub  feat  of  slightly  over  30  percent  of  the  Events.  Of 
those,  about  3  percent  actually  resulted  in  the  creation  of  a  new  mate¬ 
rial.  The  remaining  97  percent  dealt  with  the  exploitation  of  a  new 
material's  characteristics  (a)  to  permit  the  use  of  a  new  manufac tiering 
process  (13  percent),  (b)  to  enable  the  development  of  a  new  device 

(16  percent),  or  (a)  to  advantageously  replace  an  older  material  for 
reasons  other  than  manufacturing  economy  (38  percent). 

For  example,  the  last  category  might  include  the  replacement  of 
germanium  by  silicon  in  solid-state  devices,  or  the  use  of  aluminum  in¬ 
stead  of  steel  In  the  carriage  of  a  howitzer. 

In  general,  this  finding  clearly  demonstrates  the  importance  of 
materials  research  in  the  advancing  of  technological  capability.  The 


Oistribut  ions  within  this  30  percent  of  Events,  however,  suggest  that 
efforts  devoted  to  gaining  u  complete  understanding  of  all  character¬ 
istics  ol  a  new  material  and  to  ensuring  that  this  knowledge  was  widely 
distributed  throughout  the  engineering  community  would  be  more  useful 
than  attempts  merely  to  seek  another,  somehow  improved  material.  Ob¬ 
viously,  a  commensurate  recommendation  \  ou Id  be  slated  in  terms',  of 
relative  emphasis  rather  than  a  choice  ot  alternatives. 

5. 1.2.3  Functions:  |R  determining  whether  the  consequence 
of  an  Event  was  the  ability  to  accomplish  a  new  function,  as  opposed  to 
improved  ways  of  performing  an  established  function,  it  was  necessary 
to  use  definitional  criteria. 

In  general,  if  an  older  device  or  technique  could  have  been  used 
to  achieve  the  operational  characteristics  set  by  the  engineei — even  at 
a  higher  cost  or  with  slightly  less  reliability — It  was  held  that  the 
Event  merely  offered  better  ways  of  executing  an  establ I  shed  function. 
Converselv,  if  the  Event  resulted  in  a  higher  level  of  capability  than 
existed  before  (e.g.,  greater  power  output  by  a  radar  transmitting  tube, 
higher  specific  impulse  of  a  new  propellant),  the  result  was  considered 
to  be  a  new  capability. 

Within  these  broad  criteria ,  t)ie  invention  of  devices  or  tech¬ 
niques,  other  than  through  the  exploitation  of  a  new  material ,  aceounted 
for  33  percent  of  the  Events.  About  75  percent  of  these  made  possible  a 
new  function  or  offered  a  new  capability j  25  percent  offered  improved 
ways  of  accomplishing  an  established  function.  These  figures  suggest 
that,  early  In  the  engineering  development  of  a  system,  about  three  times 
as  much  attention  is  paid  to  meeting  performance  specifications  as  is 
given  to  lowering  cost  or  increasing  the  system's  reliability.  The  data 
would  therefore  support  the  hypothesis  that,  at  the  time  of  engineering 
development,  most  advanced  weapon  systems  are  at  or  near  the  technologi¬ 
cal  state  of  the  art. 

5- I .2.4  Design:  Inventions,  or  concepts ,  involving  ap¬ 
proaches  to  system  or  subsystem  design  were  the  bases  for  a  little  more 
than  4  percent  of  the  Events ,  or  an  average  of  about  1 . 5  Events  per 
system  studied. 

In  the  opinion  of  the  study  teams,  this  suggests  that  the  funda¬ 
mental  concepts -under  1 y Ing  these  systems  and  major  subsystems  did  not 
differ  greatly  from  those  on  which  other  existing  military  equipments 
of  lower  performance  were  based.  The  main  conclusion  is  that  markedly 
advanced  new  weapon  systems  emerge  as  a  consequence  of  the  skillful 
selection  and  integration  of  many  innovations  from  diverse  technologies, 
which  combine  to  produce  the  performance  demanded. :  It  is  uni ikely  that 
such  weapons  would  come  into  being  as  the  result  of  the  mythical  "great 
new  i  dea."  s  .  . 
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5.  1, 2,5  Problem  Ana  lysis  :  Almost  Ml  pet  cent  of  tin*  lv(  nts 
evidence  a  different  but  not  necessarily  unexpected  Ut«ir«»ctc*r  i  si  i  c  . 

They  appear  to  consist  of  ana  I  y/  i  ng  a  problem  in  detail  arid  coupling  the 
results  with  an  almost  morphological  survey  of  available  technologies  in 
order  to  find  a  useful  solution.  None  of  these  Events  can  be  described 
as  ,•  period  of  creativity  followed  by  the  lest  of  an  idea  that  came  into 
befog  duf tity  that  period.  The  ingenuity  observed  in  this  class  of 
Events  is  revealed  more  particularly  in  the  framing  and  analysis  of  tin* 
problem  than  in  t lie  eventual  solution. 

Philosophically,  tire  activity  described  would  seent  to  '->1  low  the 
common  concept  of  engineering  more  closely  than  the  finding  5.1*2. 3) 
that  some  33  percent  were  inspirational  inventions.  If  the  data  had 
been  structured  somewhat  differently  in  this  portion  of  the  report,  many 
Events  included  in  the  discussions  of  scientific  research  (5.1.2. 1)  and 
materials  (5 .1.2.2)  would  also  have  consisted  of  analysis  followed  by 
solution.  In  fact,  that  may  be  a  more  typical  description  of  an  Event 
than  the  one  chosen  for  the  HINDSIGHT  study  (see  Appendix  B).  U  cer¬ 
tainly  is  easier  to  understand  the  high  cost  of  scientific  and  technical 
research  when  one  appreciates  the  tremendous  amount  of  analysis  and 
search  involved. 

5. 1.2, 6  Other  Events:  Finally,  11  percent  of  the  Events 
lack  any  obviously  common  characteristic,  except  that  each  Involves 
some  amount  of  creativity  or  ingenuity. 

5.1.3  Content  of  the  Events:  The  Events  can  also  be  usefully  cate¬ 
gorized  in  terms  of  the'  primary  scientific  or  technical  area  involved. 
Since  the  weapon  systems  and  equipments  selected  for  this  study  are  gen¬ 
erally  typical  of  those  that  are  Important  to  the  DoD,  It  may  be  conjec¬ 
tured  that  a  ranking  of  the  sciences  and  technologies,  in  terms  of  the 
frequency  with  which  Events  occurred  in  each,  would  give  a  measure  of 
their  relative  importance  in,  at  least,  the  immediate  past.  The  Field 
and  Group  Structu reclassification  code  and  descriptors  of  the  Committee 
on  Scientific  and  Technical  Information  (CQSATl)  were  used,  with  the 
resultant  distribution  shown  in  Table  VIII. 

It  cannot  be  concluded  from  these  data  that  electronics  Is  more 
important  to  a  missile  system  than,  for  example,  propulsion,  navigation 
or  communications.  In  the  absence  of  any  one  of  them,  the  final  system 
would  very  likely  be  Inadequate.  Because  each  Event  involved  skilled 
people,  however,  the  distribution  In  Table  VH  I  suggests  the  relative 
number  of  scientists  and  technologists  that  would  be  required  In  each  of 
the  areas  listed  to  maintain  a  balanced  base  of  professionals. 


%COSATI  Subject ‘Category  List  (DoD-Exteridea)  (Washington,  D .C . : 
Defense  Documentation  Center,  Defense  Supply  Agency,  AD-62^  000,  Decem¬ 
ber  1965).  [COSAT I  — - Commi ttee  on  Scientific' and  Technical  Information, 

Federal  Council  for  Science  and  Technology.] 
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Table  VIII.  SCIENTIFIC  AND  TECHNICAL  AREAS  OF  EVENTS: 

FREQUENCY  OF  OCCURRENCE 


Area  _ _  % 


Electronics  — - - - * - - -  25.2 

Ordnance--—-- - - - ■*■- -  12.3 

Missile  technology — - - 10.5 

Propulsion  and  fuels - - - -— - 9.9 

Aeronautical  science-- - — ■ - - - — - —  9.9 

Materials  science - - - - — - — 7.7 

Navigation  and  communications - - »  6.4 

Physics - - - - - - - --------  5.3 

Mechanical  and  civil  engineering - - —  3-2 

Methods  and  equipment - - * — -- —  2.1 

Behavioral  science - - 1.9 

Chemical  technology - 1.7 

Mathematics— - - - - l  .5 

Nuclear  science- — - ----- - —  0.6 

Biological  science - - — — — — ■ - -: -  0.6 

Atmospheric  science--- — - — -  0.4 

Military  science-—-— - - - - - 0.4 

Energy  conversion- - * — — - - - — — -  0.4 


5.2  Motivation  for  the  Events 

In  this  study,  motivation  is  defined  in  a  very  narrow  sense.  The 
objective  here  was  to  ascertain  what  recognizable  influence,  if  any,  led 
directly  to  the  creative  act  identified  as  the  start  of  an  Event,  Ex¬ 
cluded  were  such  matters  as  the  reason  the  performer  was  in,  a  position 
to  do  the  relevant  work,  whether  the  effort  was  sought  of  his  own  voli¬ 
tion,  what  personal  drives  may  have  contributed  to  his  motivation,  and 
the  like.  In  this  way,  the  task  was  considerably  simplified. 

5.2.1  Kinds  of  Motivation;  The  "permitted11  categories  of  motiva¬ 
tion  were  those  shown  in  Table  IX.  Definitions  of  directed  and  undi¬ 
rected  research  are  given  in  Tables  III  and  IV.  Alternatively,  these 
categories  might  be  more  adequately  described  as  phenomena-oriented  and 
appl ications-or tented  research— but  only  if  it  is  clearly  understood 
that  neither  orientation  Would  exclude  Investigations  of  a  basic  nature. 
Within  these  definitions,  the  eight  very  important  Events  In  the  history 
of  the  transistor  are  classified  as  directed  research  because  they  all 
occurred  at  the  Bell  Telephone  Laboratories,  which  is  obviously  appli¬ 
cations  oriented. 
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Fable  IX,  DISTRIBUTION  OF  MU  1 1VAI10NAL  LAFLGORIFS 


Category  of  motivation 


Science: 

Directed  research  (DoD)  7.0 

Directed  research  (non-DoD)  2.0 

Undirected  research  (0.2) 

Technology:  •••>.•■ 

Generic  (DoD-oriented)  27,0  +2 

Advanced  development  or  system  concept  41.0  +2 

System  In  engineering  development  20.0 

Not  DoD-oriented  3.0 


In  generic  technology,  the  attention  of  the  performer  is  directed 
to  a  broad  spectrum  of  functionally  similar,  general-purpose  technologi¬ 
cal  building  blocks.  Examples  of  this  class  are  general-purpose  transis¬ 
tors,  ferrous  and  sortie  nonferrous  structural  materials,  liquid  and  solid 
rocket  propellants,  explosives,  and  printed-circuit  boards.  As  the 
focus  of  the  performer's  attention  is  sharpened  by  the  consideration  of 
possible  specific  applications  suggested  by  a  particular  system  concept 
or  by  a  system  actually  in  preprototype  development,  the  motivation  for 
his  efforts  falls  into  a  new  category — advanced  development  or  system 
concept. 

There  is  an  overlapping  of  generic  and  system-concept  technology  in 
many  aspects,  especially  when  the  same  people  are  responsible  for  both 
system  design  and  the  sponsoring  of  growth  in  the  relevant  technologies. 
For  example,  there  are  regions  of  technological  overlap  in  missile  guid¬ 
ance  and  radar  in  which  it  is  difficult  to  assign  an  effort  to  either 
category  with  any  degree  of  certainty.  Further,  the  performer  often 
finds  it  hard  to  unequi vocably  trace  his  motivation.  Thus,  from  2  to  3 
percent  of  the  Events  shown  as  generic  and  system-concept  technology 
might  be  shifted. 

5,2,2  Other  Motivational  Links:  In  addition  to  determining  the 
performer's  motivation,  information  was  sought  regarding  other,  non- 
psychological  factors  that  might  have  directed  his  attention  toward  the 
activity  that  culminated  in  an  Event.  In  a  very  crude  sense,  the  moti¬ 
vation  was  the  objective  that  guided  the  performer,  whereas  the  motiva¬ 
tional  link  is  the  reason  he  was  so  guided. 

Table  X  presents  the  distribution  of  Events  among  the  eight  most 
obvious  links.  The  three  percentage  columns  shew  the  sequential  partici¬ 
pation  of  each  link  in  an  Event  involving  additional  acts  of  creativity. 
Of  the  several  categories,  contractual  requirement,  routine  area  assign¬ 
ment,  and  spontaneous  internal  conception  are  self-explanatory.  In  the 
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otliiTV,  l ho  porlmniors  wero  informed  of  the  existence  ol  o  nec-d,  01  j 
possible  solution  for  on  .it  ready  identified  problem, 'by  way  of  the  in 
dicoted  transfer  I  ink. 


Table  X.-  MOTIVATIONAL  LINKS 


Category 

Primary  (%) 

Secondary  (%) 

Tertiary  (X) 

Contractual  requirement- 

—  11.1 

30.5 

38.1 

Routine  area  assignment- 

. 47.8 

42.7 

33.3 

Technical  report-- — : — 

— —  14.8 

18.1 

16.6 

Professional  meeting - 

Extraorganizational 

.  1.5 

2.2 

4.8 

person- to-.per  son — — 
Spontaneous  internal 

-  8.0 

5.1 

*  2.4 

conception - - 

Analysis  of  foreign 

-----  9.5 

0 

0 

product—— - 

.  0.5 

0 

2.4 

Newly  hired  personnel  — 

.  1.6 

1.4 

2.4 

No  link  apparent— - 

■ .  5.2 

0 

0 

The  dominance  of  the  routine  area  assignment  among  these  categories 
should  have  been  anticipated  in  the  light  of  other  findings  of  this 
study.  As  noted  in  connection  with  finding  A. 3-7,  in  85  percent  of  the 
Events  the  creative  activity  was  in  response  to  a  problem  brought  from 
outside  the  performing  group.  Where  more  logically  should  a  problem  be 
taken  than  to  a  group  of  professionals  who  are  known  to  be  regularly 
working  in  a  technical  area  in  which  a  solution  is  likely  to  be  found? 
And  what  most  probably  would  be  the  nature  of  a  solution  offered  by  a 
group  that  Is  active  in  certain  technological  areas? 

In  describing  the  production  rate  of  RXD  Events,  Table  VII  (page 
48)  demonstrates  that  a  mission-oriented  establishment  (the  in-house 
laboratory),  if  at  all  involved  in  an  Event,  tends  to  be  deeply  involved. 
Apparently,  having  developed  expertise  in  areas  pertinent  to  its  mission, 
the  laboratory  Is  brought  relevant  problems  by  outside  organizations 
that  recognize  this  expertise. 

These  findings  form  a  consistent  pattern  and  consequently  offer 
some  guidance  to  management.  They  suggest  that  usable  ideas  are  more 
likely  to  be  produced  if  an  organization  deliberately  establishes  a 
reputation  for  skill  in  a  limited  number  of  problem-associated  technol¬ 
ogies,  instead  of  diversifying  its  talents  over  a  wide  range  of  techni¬ 
cal  Fi elds. 
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'» .  j  Funding  of  Event b 

Inf.tinut  ion  was  gathered  with  regard  1  o  two  aspect*,  of  Event  luml- 
ing:  (I)  Who  furnished  the  money?  (?)  Approximately  how  much  money  was 

involved?  An  Event  was  restricted  by  definition  to  the  "initial  demon¬ 
stration  of  validity  or  . feosibi  I  i ty"  in  the  hope  of  keep i nu  the  number 
of  funding  sources  to  a  inaitageatilo  minimum,  but  even  so  multiple  funding 
was  found  to  be  a  coiution  occurrence.  In  fact,  20  percent  of  the  Events 
had  at  least  two  simultaneous  or  consecutive  sponsors,  and  6  percent  had 
at  least  three.  Dual  funding  by  consecutive  sources  appears  to  have 
resulted  from  one  or  more  of  several  situations: 

(1)  The  idea  occurs  in  an  organization  that  is  unwilling  to 
fund  more  than  the  most  superficial  test; 

(2)  The  idea  occurs  in  an  organization  that  lacks  the  techni¬ 
cal  ability  to  accomplish  the  requisite  tests;  or 

(3)  The  idea  occurs  in,  and  is  tested  by,  one  organization, 
but  a  second  organization  which  is  unwilling  to  accept  those  test 
results  funds  a  more  detailed  project. 

The  simultaneous  funding  by  multiple  sources  invariably  happened 
when  two  or  more  organizations  were  interested  in  pursuing  an  idea  and 
agreed  to  share  expenses  or  talent,  or  both. 

Table  XI  shows  the  frequency  with  which  the  several  identified 
funding  sources  appeared. ' 


Table  XI.  FUNDING  DISTRIBUTION  FREQUENCY 


Source 

Primary 

Secondary 

Tertiary 

Department  of  Defense - 

Defense-oriented  industry: 

—  574 

131 

37 

Specified  industrial  R&D- 
Specified  profits  from 

—  18 

1 

0 

other  DoD  contract - 

3 

0 

0 

Unspecified - 

—  51 

2 

0 

Non-defense  industry - 

—  35 

4 

2 

Non-DoD  Federal  — — ■ - ■— 

8 

0 

0 

Foreign  and  miscellaneous-- 

9 

0 

0 

Table  XII  reduces  these  data  to  participation  percentages  on  the 
basis  of  number  of  Events  rather  than  funding  level. 
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l  uiiUi'Ki  source 


Department  of  Defense  B4.H 
Defense-oriented  industry  8.6 
Other  industry  4.6 
Other  Federal  1.0 
foreign  and  miscellaneous  1.0 


Each  of  the  28  Events  in  which  there  was  simultaneous  multiple 
funding  involved  the  OoD  as  one  contributor  and  defense-oriented  industry 
os  the  other.  Distribution  of  consecutive  funding  participation  by 
sponsor  may  be  inferred  front  Table  XI.  Where  the  initial  support  came 
from  either  the  OoD  or  defense-oriented  industry,  the  follow-up  support 
was  provided  by  the  DoD.  Where  non  defense  industry  furnished  the 
initial  support,  it  tended  also  to  give  the  fol low-up  support . 

The  actual  dollar  level  at  which  a  given  Event  was  supported  varied 
from  none  (other  than  the  performer's  salary  for  a  few  days  up  to  a 
week)  to  figures  well  in  excess  of  a  million  dollars.  The  Information 
was  provided  by  the  Event  performers,  who  generally  attempted  to  esti¬ 
mate,  in  terms  of  men,  materials  and  overhead,  a  dollar  equivalent  that 
would  be  an  approximate  measure  of  the  Event's  cost.  These  data  are 
considered  roughly  indicative  of  the  cost  of  advances  in  science  and 
technology. 


t, 
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Because  these  estimates  concerned  the  approximate  cost  of  incidents 
that  had  occurred  as  much  as  20  years  before,  and  because  there  was 
little  uniformity  in  the  way  the  many  study  participants  applied  the 
definition  of  an  Event,  an  average  Event  cost  is  not  a  particularly 
meaningful  figure.  Instead,  the  median  cost  of  an  Event  is  offered  as 
being  more  descriptive  of  the  situation.  Table  XIII  gives  median  cost 
Figures  for  the  dominant  Event  categories,  and  Table  XIV  displays  Event 
cost  distribution,  regardless  of  source  or  other  factors. 

Table  XIII.  MEDIAN  COST  OF  EVENTS 


Science  $60,000 
Technology  (DoD-funded  Event)  45,000 
Technology  (industry-funded  Event)  33,000 
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Table  XIV.  DISTRIBUTION  OF  LVF.NT  COST 


Cos t  ranja.e _ ..... _ 

_ X 

Under  $10,000 

17.7 

$10,000  -  $50,000 

32.6 

$50,000  -  $100,000 

19.0 

$100,000  -  $250,000 

17.0 

$250,000  -  $500,000 

6.3 

$500,000  -  $1,000,000 

3.5 

Over  $1,000,000 

3.9 

5.4  Idea  Protection 

The  flow  of  ideas,  as  well  as  their  application,  may  be  restrained 
by  controlling  the  information  in  three  ways:  Assigning  it  a  Defense 
security  classification,  labeling  it  proprietary,  usually  to  industry, 
or  subjecting  it  to  the  patent  process.  The  incidence  of  these  re¬ 
straints  among  the  710  Events  is  shown  In  Table  XV.  Since  it  is  possible 
for  an  idea  to  be  patented  and  at  the  same  time  classified  as  Defense 
security  information,  the  percentile  figures  are  not  additive.  Nor  is 
"Special  Handling"  additive,  for  it  is  a  subclass  of  both  "Secret"  and 
"Confidential."  The  number  of  Events  that  are  (or  were)  considered  to 
be  proprietary  information  by  the  performing  organizations  Is  not  known. 

Table  XV.  IDEA  PROTECTION 


Restraint _ ■ _ % 


Defense  security  classification: 


Special  Handling 

2.5 

Secret 

4.6 

Confidential 

12.2 

Patented 

18.0 

Recognizing  that  this  study  has  identified  most  of  the  important 
scientific  and  technical  advances  in  weaponry  and  other  mi  1 i tary  equip¬ 
ments  over  the  past  two  decades,  and  in  viewof  the  current  European 
concern  over  the  so-called  technology  gap,^®  these  data  are  particular¬ 
ly  enlightening.  To  the  extent  that  such  a  gap  exists,  Federal  security 


1°H.R,  Lieberman,  "Technology  Gap  Upsets  Europe,"  New  York  Timer., 
12  March  1 967 » 


control  over  the  flow  of  inf  omul  ion  is.  obvious  ly  not  a  significant  con¬ 
tributor.  In  Bj  percent  of  the  cases  there  was  no  legal  constraint  on 
open  pub  I i cat  ion  of  the  information. 

The  data,  of  course,  do  not  measure  the  effect  on  information  flow 
of  constraints  imposed  by  Defense  contractors,  either  by  discouraging 
their  people  who  might  desire  to  publish  or  placing  deliberate  restric¬ 
tions  on  proprietary,  information, 

5. 5  Participating  Organizations 

In  the, same  way  that  an  attempt  was  made  to  curtail  fundi ng  sources 
the  definition  of  an  Event  was  deliberately  framed  to  minimize  the  pos¬ 
sibility  that  a  number  of  organizations  would  be  found  to  have  partici¬ 
pated  in  any  one  Event.  Again,  success  was  not  complete.  Only  in  78 
percent  of  the  Events  was  al 1  the  technical  work  done  within  a  single 
organization.  In  17  percent  of  the  cases,  two  organ! zat ions  were  iden¬ 
tified,  and  in  6  percent  there  were  three.  Where  multiple  performing 
organizations  were  identified,  the  combinations  included  the  following: 

Government  laboratory  /  Government  laboratory  ' 

Government  laboratory  /  university 

Government  laboratory  /  industry 

,  industry  /  university  >■- 
industry  /  industry 

Thus  it  is  not  highly  Illuminating  to  discuss  the  distribution  of  per¬ 
forming  organizations  in  terms  of  percent  of  Events  by  organizational 
class.  Instead,  Table  XVI  presents  the  incidence  of  participation  in 
Events  as  a  function  of  organization  class. 

Table  XVI.  INCIDENCE  OF  TECHNICAL  PARTICIPATION 
,  BY  CLASS  OF  PERFORMING  ORGANIZATION 

•  Incidence 


Organization  class _  (%) 

Government  1  aboratory - - -  43 . 6 

DoD— . — - - - —  (42.3) 

non-DoD — — — - - - — (  0.9) 

industry-operated - - - - —  (  0.4) 

Industrial--- - - — - —  44.2 

profit - - — — - - - — — —  (42.3) 

not-for-profit - - — - - (  1.9) 

University - - - — - — — - - — -  10.6 

academic  institution—. - — - (  5.4) 

research  center -  (  5.2) 

Foreiqn  laboratory  (all  classes) -  1.6 

100.0 
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Sinci*  lablt*  XVI  covers  Hie  till  n  c  pel  i  ml  In*  l9'i!>  lb  f'jtij,  it  iv - 
not  ,i  measure  of  the  cutrent  i  e  lut  i  Vi  ■  impui  tnnci*  nl  these  nty.iiit  rat  i  nn  u 
classes,  1  he  l rend  in  relative  impot  Utiice  ot  the'  Cover iink-hI  1  riboi'ul  ji y 
and  industry,  the  two  primary  contributors  river  Hu*  who  I  e  I  i  im.-  Iraim.-,  i 
illustrated  in  Figure  \2  (page  38). 

Section  *1,3.1  noted  that  about  /b  percent  of  the  university- 
credited  RXl'  t vents  came  from  associated  science  and  technology  centeis 
or  arose  out  of  recognizably  mission-oriented  programs  (e.g.  ,  tin;  loves 
ligations  in  missile  base  drag  charade-  Kt  ics,  Event  No.  0060,  under 
the  direction  of  Professor  Korst,  University  of  Illinois).  About  half 
of  the  RXD  Events  that  look  place  in  academic  institutions  proper  fell 
into  the  category  of  those  that  were  recognizably  mission  oriented. 
Thus,  the  referenced  paragraph  and  Table  XVI  are  consistent. 

5,6  Contributing  Scientific  and  Technical  Personnel 


In  tracing  the  histories  of  the  utilized  new  science  and  technology, 
1,295  people  were  identified  as  having  made  significant  contributions  to 
RXD  Events.  Detailed  personnel  rdsumds  were  obtained  from  51A,  almost 
itO  percent  of  them.  Analysis  of  those  rfisumfis  provides  the  distributions 
pre;  -nted  in  subsequent  paragraphs. 

Two  relatively  simple  tests  were  applied  to  the  sample  as  a  check 
on  its  validity.  In  the  first  test,  the  distribution  of  rfisumSs,  in 
terms  of  category  of  employing  organization,  was  compared  with  the  dis¬ 
tribution  of  Events  that  occurred  within  that  organizational  class.  The 
results  of  this  test  are  shown  in  Table  XVII. 

Table  XVII.  DISTRIBUTION  OF  R&UM£S  AND  EVENTS  BY  ORGANIZATION  CLASS 


Organization  class 


Events  {%) 


Resumes 


In-house  laboratories 
Industry 
Universities 
Other 


The  second  test,  involving  a  time  distribution  study,  was  to  com¬ 
pare  the  percentage  of  the  total  number  of  Events  that  occurred  in  a 
given  year  with  the  percentage  of  the  r6sum£s  that  applied  to  individuals 
who  had  made  their  contributions  in  that  year.  The  findings  demons  tret  * 
a  positive  correlation  at  the  0.93  level.11  The  rdsumds  seem  to  be  a 
usefully  valid  sample.  The  slight  bias  in  favor  of  Industrial  per¬ 
formers  will  be  considered  later. 


11  Spearman's  coefficient  of  rank  correlation; 

r  =  1 - -jpli—  where:  d  =  difference  in  ranks. 

n'n  n  =  number  of  items  ranked. 
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A  iimTuI  and  unique  ch.ir.n  let  isl  ic  of  I  In-  pci  sennit'  I  ilal.i  till;  is 
that  ••very  lii.u  t’l  1  lit:  individuals  whose  desci  ipl  ions  make  up  tin-  file 
is  known  to  have  made  a  util  i/e  I  contribution  to  Defense  scicncf  or 
technology.  ill  is  factor  permits  useful  compa  i  i  sons  between  tin;  II I  NDS  I Kill  I 
contributors  and  the  general  scientific  and  technical  conniiuni  t  ies  of  the 
nation.  The  unique  aspect  of  the  file  is  that  i.l  offers,  mi  opportunity 
to  lest  a  number  of  hypotheses  regarding  .productivity  and  the  consc- 
Tjfieni.es  of  managerial  pol  icy  act  ions.  Such  comparisons  and  analyses  are 
presented  in  sec t  ions  5.  7  through  5. II. 

5.7  'Education 

Taole  XVIII  shows  the  distribution  of  academic  degree  levels  among 
the  identified  contributors  and  comparable  data  for  the  entire national 
scientific  arid  engineering  community. 

Table  XVIII.  EDUCATIONAL  LEVEL  OF  IDENTIFIED  CONTRIBUTORS 


Source  of  Data* 


Degree 

HINDSIGHT 

.  NORC 

SRI 

NSF 

EJC 

Ph.D. 

10.5%' 

3.1% 

'i.2% 

3.8%  1 

f 

M.S. 

22.5% 

8.6% 

7.2% 

i 

,63% 

B.S. 

57.0% 

34.6% 

47.0% 

1 

L  ■ 

Some  college 

6.8% 

39.5%  . 

■[44.6% 

J 

[37% 

No  college 

3.2% 

14.2% 

. :  1 

Note :  ^Sources  of  data  are  as  follows: 

NORC:  S.  Warkov  and  J.  Marsh,  The  Education  and  Training  of 
America's  Scientists  and  Engineers:  1962  (Chicago: 
National  Opinion  Research  Center,  University  of  Chicago, 
October  1965),  p .  17. 

SRI  :  .  A.\ . Shape  ro,R.P.  Howell  and  J.R.  Tombaugh,  An  Exploratory 
j  Stilly  of  the  Structure  and  Dynamics  of  the  RSD  Industry 
(M6n'lo  Park,  California:  Stanford  Research  Institute, 

-  Jun&  ’  196^1) ,  p.  3 1  *,  ...  ' 

NSF:  Profile s  of  Manpower  in  Science  and  Technology  (Washington 

D.C.:  National  Science  Foundation,  NSF  63"23,  1963), 

P.  1 7ff .  . 

EJC:  "How  Many  Engineers?"  Engineering  Manpower  Bulletin,  No.  5 

Engineers'  Joint  Council,  New  York,  July  1 966 . 


At  the  Ph.D.  level,  data  Iron  the  Stanford  Research  Institute  (SRI) 
are  probably  the  most  useful  for  comparison  purposes;  that  is,  for  Ph.l),, 
the  10,5  percent  identified  through  Project  HINDSIGHT  should  be  compared 
with  the  1:2  percent  in  the  SRI  column.  Tlte  pharmaceutical,  petrochemi¬ 
cal,  biological,  anthropological  and  sociological  ileitis,  with  their 
relatively  heavy  concentration  of  Ph.D.'s,  markedly  influence  the  data 
of  the  National  Opinion  Research  Center  (NORC)  and  the  National  Science 
Foundation  (NSF) ;  this  condition  is  not  significant  In  the  SRI  data  be¬ 
cause  that  related  primarily  to  the  defense  aerospace  community.  The 
equipments  chosen  for  the  HINDSIGHT  study  mitigated  against  any  strong 
contribution  from  these  Ph.D. -heavy  fields,  so  it  is  reasonable  to 
exclude  them  entirely  from  this  particular  analysis. 

At  the  M.S.  level,  the  difference  between  the  SRI  ,pnd  NORC  data  is 
probably  not  statistically  significant. 

5.7.1  Hypotheses:  A  comparison  of  the  educational -level  distribu¬ 
tions  with  those  of  any  other  source  clearly  suggests  that  the  identified 
contributors  do  not  constitute  a  random  sample  of  the  general  scientific 
and  engineering  community.  Prevalence  of  the  Ph.D.  degree  Is  more  than 
eight  times  greater  than  would  bo  expected;  the  M.S.  degree,  over  three 
times  greater.  This  observation  might  be  explained,  wholly  or  Impart, 
by  one  or  more  of  several  hypotheses.  Perhaps — 

(1)  "there  Is  a  positive  correlation  between  the  technical 
nature  and  the  amount  of  formal  education  to  which  an  Individual  is  ex¬ 
posed  and  his  propensity  for  producing  knowledge  that  is  useful  in 
defense  weaponry; 

(2)  the  personal  qualities  that  drive  an  individual  to  seek 
progressively  higher  academic  degrees  are  quite  similar  to  those  requi¬ 
site  to  successful  performance  as  a  contributor  of  science  and  technol¬ 
ogy  useful  to  Defense;  or 

(3)  the  prestige  of  the  higher  educational  level  places  the 
Individual  in  a  position  affording  greater  opportunity  to  perform. 

The  principal  findings  of  Project  HINDSIGHT  (as  presented  in  section 
4)  develop  a  strong  case  for  the  DoD's  support  of  directed  research  in 
science  and  technology.  They  do  not— -perhaps  because  of  the  more  tenuous 
information  flow  and  communication  path  between  the  universities  and 
Defense  engineering— -make  as  strong  an  argument  for  continued  DoD  support 
of  the  less  well-directed  scientific  investigations  In  the  academi c  en¬ 
vironment.-  There  are  good  reasons  for  the  DoD's  support  of  university 
research,  however,  and  a  quantitative  demonstration  of  their  validity  is 
possible. 

An  important  part  of  the  argument  resides  in  the  demonstration  that 
the  first  of  the  foregoing  three  hypotheses  is  clearly  valid  and  better 
explains  the  correlation  between  degree  level  and  product ivl  ty.  The 


consequence  of  DoD  influence  on  the  choice  ol  scientific  area  of -concen¬ 
tration  in  the  supported  universities  is  manifested  by  the  relatively 
greater  portion  of  those  institutions'  graduates  who  eventually  make 
militarily  significant  contributions  to  science  and  technology. 

5.7.-  Sources  of  Education:  Among  the  identified  performers,  98 
percent  ot  the  degrees  were  awarded  by  colleges  or  universities  In  the 
United  States.  The  remaining  2  percent,  awarded  by  foreign  Institutions, 
were  almost  exclusively  Bachelor's  degrees,  B.S.  or  B.A.  In  1959,  ap¬ 
proximately  the  year  of  the  median  Event  considered  in  Project  HINDSIGHT, 
the  uni  vers i ty-trained  scientific  and  eng i nee ri ng  manpower  of  the  United 
States  was  slightly  in  excess  of  1.09  million  people.151  Of  these,  about 
20,000  were  immigrants  who  had  received  their  education  abroad.13  Thus, 
on  the  assumption  that  there  is  no  correlation  between  source  of  the 
degree  and  propensity  for  productivity  in  defense-oriented  science  and 
technology,  it  would  be  expected  that  about  2  percent  of  the  identified 
performers  would  have  received  their  degrees  at  foreign  universities  — 
precisely  the  finding  of  this  study  insofar  as  the  B.S. /B.A.  level  is 
concerned. 

The  B.S.  degrees  awarded  in  the  United  States  came  from  more  than 
70  colleges  and  universities.  The  distribution  among  these  many  insti¬ 
tutions  appears  to  correlate  solely — and  then,  very  crudely — with  the 
size  of  the  university  and  its  proximitv  to  the  industrial  organizations 
and  Government  laboratories  that  contributed  large  numbers  of  Events. 

Both  observations  tend  to  support  the  hypothesis  that  prestige,  or  some 
unidentified  personal  characteristics,  account  for  the  disproportionately 
high  percentage  of  degreed  individuals  among  the  Event  performers— at 
least,  at  the  B.S. /B.A.  level. 

Table  XIX  lists  fields  of  technical  activity14  represented  by  the 
identified  i.XD  Events  and  shows  the  relative  distribution  of  B.S. /B.A. 
fields  among  the  performers  in  each  technical  area.  The  data  in  this 
table  clearly  demonstrate  a  very  marked  correlation  between  the  specific 
area  in  which  the  person  was  educated  and  the  one  in  which  he  usefully 
performs.  Even  though  degree  holders  In  technical  areas  other  than  those 
closely  associated  with  a  given  Event  had  essentially  the  same  total 
exposure  to  formal  education — and  presumably  the  same  amount  of  degree- 
conveyed  prestige— as  individuals  whose  education  was  within  the  closely 
associated  degree  area,  relatively  few  "cross-field"  accomplishments  are 
seen.  This  observation  Is  offered  in  partial  support  of  the  first 


12"Resoiirces  of  Scientific  and  Technical  Personnel  In  the  OECD  Area, 
1963 Manpower  Statistics,  1954-1964  (Paris:  Organization  for  Economic 
Cooperation  and  Development,  1965). 

l^Saientifio  Manpower  from  Abroad  (Washington,  D.C.:  National  Science 
Foundation,  NSF  62-24,  1 962) . 

lhC0SATI  Subject  Category  List  (DoD-Extended) ,  op. ait. 


Table  XIX.  PROFESSIONAL  MOBILITY  AT  THE  B.S./B.A.  LEVEL 
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hypothesis  'stated  above— that  .there,  is  a  positive  correlation  between  the 
technical'  nature  and  amount  of  formal  educat ion  to  which  an  individual  is 
exposed  and  his  propensity  for  producing  useful  knowledge. 

Additional  support  for  this  hypothesis  is  obtained  by  considering 
the  sources  of  the  M.S.  and  Ph.D.  degrees  held  by  the  Identified  per¬ 
formers.  Although  the  Department  of  Defense  has  supported  research  In 
about  200  colleges  and  universities  throughout  the  United  States,  the 
larger  share  of  this  support  has  gone  to  a  relatively  small  group  of  them. 
If  the  research  efforts  supported  by  the  DoD  were  closely  related  to  the 
technical  areas  of  defense  weaponry,  and  If  there  is  a  correlation  be¬ 
tween  nature  and  amount  of  formal  education  and  propensity  for  producing 
useful  knowl edge,1 there  should  be  a  correlation  between  the  amount  of 
DoD  funding  support  received  and  the  number  of > identified  performers 
graduated.  That  is,  the  universities  heavily  involved  in  defense- 
oriented  research  should  be  producing  a  relatively  greater  number  of 
scientists  and  engineers  with  a  defense- technology  orientation  than  those 
concentrating  their  research  activities  more  heavily  elsewhere. 

Considering  first  the  identified  performers  who  have  been  awarded  a 
Ph.D.:  The  top  23  universities ,  in  terms  of  Support  received  from  the 
DoD  for  research,  awarded  approximately — 25  percent15  of  the  Ph.D.'s  in 
the  physical  sciences  and  engineering  during  the  period  of  primary  in¬ 
terest  to  the  HINDSIGHT  study.  Slightly  in  excess  of  50  percent  of  the 
identified  performers,  or  a  factor  of  more  than  2:1  over  random  expec¬ 
tation,  received  their  highest  level  degrees  from  those  universities. 

At  the  M.S.  level,  a  similar  situation  exists.  In  this  case,  the 
same  universities  awarded  about  31  percent16  of  the  degrees  in  the  United 
States,  but  46  percent  of  the  Identified  performers  received  their  de¬ 
grees  from  them. 

As  these  are  the  larger  and  generally  the  better  known  of  the 
American  universities,  they  undoubtedly  have  a  strong  appeal  for  the 
better  students,  It  is  quite  likely,  therefore,  that  the  findings  just 
described  are  influenced  by  factors  other  than  simply  the  relative 
amount  of  research  supported  by  the  DoD.  In  particular,  the  phenomenon, 
"quality  seeks  quality,"  can  be  suspected  of  affecting  the  entering  stu^ 
dent.  Nevertheless,  there  is  such  a  marked  correlation  between  the  level 
of  DoD-supported  research  and  the  relative  production  of  scientists  and 
engineers  useful  to  the  DoD  that  the  hypothesis  of  interest  certainly 
appears  to  be  supported;  clearly,  the  nature  of  formal  education  is 
important.  ..  . 


15Private!y  requested  data  from  the  National  Science  Foundation. 
16IH<2. 
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5./,  3  Consequences  of  D6D  Support  of  Uni  vers,  i  ty  Research;  Al  this 
point  in  the  consideration  of  the  three  hypotheses  slated  In  section 
5-7.1,  another  matter  of  interest  should  be  noted.  The  introduction  of 
this  report  (section  I)  offered  a  hypothesis  based  on  comments  by  critics 
of  certain  OoD  policies: 

The  support  of  scientific  research  In  the  universities,  by  the 
Department  of  Defense  and  at  current  funding  levels,  signifi¬ 
cantly  affects  the  aval labl 1 i ly  of  the  best  faculty  talent  to 
teach  students.  % 

If  this  hypothesis  were  substantially  true,  It  would  be  expected  that 
graduates  of  the  less  heavily  supported  universities  would  benefit — that, 
because  the  universi ty  devoted  its  better  faculty  to  teaching  them,  the 
graduates  should  have  acquired  a  better  education  and,  everything  else 
being  equal,  should  show  up  more  frequently  in  studies  such  as  this. 
Clearly,  such  was  not  the  case  during  the  time  frame  in  which  the  Iden-  * 
tified  performers  received  their  formal  education.  The  universities 
that  were  most  heavily  engaged  in  DoD-supported  research  also  produced 
a  disproportionately  high  share  of  the  scientists  and  engineers  who  were 
important  to  the  DoD. 

Further,  inasmuch  as  the  level  of  DoD  funding  in  support  of  uni¬ 
versity  research  has  not  grown  during  the  past  few  years  as  rapidly  as 
either  (1)  total  Federal'  'support  of  research  in  the  universities  or 
(2)  graduate  education  In  the  United  States,  it  Is  most  doubtful  that 
the  hypothesis  would  be  any  more  valid  today. 

5.8  Military  Service 

In  section  4,  the  argument  was  developed  that  the  recognition  of  a 
need  is  an  important  precursor  to  the  production  of  utilized  scientific 
or  technical  Information.  It  Is  reasonable,  then,  to  suspect  that  ex¬ 
posure  to  the  military  environment  might  serve  to  Introduce  an  Individual 
to  the  needs  of  the  services  and  place  htm  in  a  favored  position  to  make 
a  contribution.  If  true,  this  proposition  could  become  of  considerable 
value  by  providing  an  additional  selection  criterion  for  employment  in 
the  defense  research  and  development  community. 

in  the  sample  of  identified  performers,  the  roughly  even  division 
of  those  who  had  mi  1 itary  experience  and  those  who  had  none  suggests, 
that,  at  least  to  a  first-order  approximation,  exposure  to  the  military 
environment  may  not  be  a  significant  factor.  But  the  prospects  of  this 
proposition  are  so  appealing  that  a  more  detailed  examination  of  the 
available  data  Is  warranted  (section  5.8.1);  moreover,  the  proposition 
sheds  further  light  on  the  hypotheses  of  section  5*7- 1  • 

In  addition,  two  possible  tests  for  other  differences  between  the 
military  veteran  and  nonveteran  populations  involve  relative  educational 
and  age  levels  at  the  time  of  contribution  (sections  5.8.2  and  5.8,3). 
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5.8.1  Nature  and  Length  of  Service:  If  a  correlation  exists  be¬ 
tween  military  service  and  the  probability  that  the  person  involved  will 
produce  militarily  useful  technology,  it  is  obvious  that  the  precise 
nature  of  the  military  role  he  played  would  be  significant.  In  that 
vein,  51  percent  of  those  reporting  previous  military  service  claimed 
that  the  nature  of  their  assignments  was  such  as  to  contribute  to  their 
future  occupation.  These  qeneral  statements  are  substantiated  by  the 
high  percentage  of  military  job  titles  such  as  "radio  and  radar  mainte¬ 
nance,"  "electronics  technician,"  "ordnance  technician,"  "a i rcraf t  main¬ 
tenance,"  and  the  like  among  those  who  reported  in  that  detail. 

Other  aspects  of  the  veteran  performers'  association  wi th  Lhe  mili¬ 
tary  services  lend  further  support  to  the  argument  that  they  are  not  a 
normal,  or  random,  segment  of  the  population.  Based  on  population  dis¬ 
tributions,  approximately  10  to  12  percent  could  have  been  expected  to 
be  commissioned  officers;  in  fact,  40  percent  were  commissioned  prior  to 
separation  from  service.  Of  that  group,  53  percent  served  during  World 
War  1 1 ,  and  47  percent,  between  1947  and  1 963.  Similarly,  of  those  who 
served  as  enlisted  men,  56  percent  were  in  the  armed  forces  during  World 
War  II,  and  44  percent  served  during  the  period  1947-1963. 

With  the  exception  of  a  few  people  who  apparently  were  called  into 
military  service  quite  early  In  World  War  II  and  served  until  the  end  of 
hostilities,  the  identified  performers  tended  to  have  2  or  3  years  of 
service.  Approximately  51  percent  of  those  with  military  experience  re¬ 
ported  2  years  or  less;  86  percent  reported  3  years  or  less. 

Thus,  a  "typical"  veteran  performer  might  be  described  as  a  young 
enlisted  technician  or  a  technical  officer.  He  had  bench-level  experi¬ 
ence  with  mi  1 i tary  equipment  and  a  real  opportunity  to  become  f ami  l  iar 
with  special  design  or  other  requirements  imposed  on  equipment  by  the 
military  environment.  This  suggests  that  these  veterans  may  wel 1  have 
gained  a  favored  position,  which  constitutes  an  obvious  advantage. 

5-8.2  Educational  Level— Veteran  vs.  Nonveteran;  There  are  Inter¬ 
esting  differences  in  the  distributions  of  graduate  degrees  held  by 
nonveterans  and  veterans,  the  latter  subdivided  into  two  groups— com¬ 
missioned  officers  and  enlisted  men.  These  distributions,  shown  in 
Table  XX,  suggest  that  the  commissioned  veteran  was  more  apt  to  have  a 
higher  degree  than  either  the  nonveteran  or  the  enlisted  veteran,  in 
that  order.  This  ordering,  although  not  denying  that  military  service 
had  put  the  individual  in  a  favored  position  to  perform  usefully,  tends 
to  support  the  second  hypothes i s  of  section  5.7.1.  In  fact,  it  appears 
that  the  hypothesis  can  be  extended  as  follows:  The  personal  qualities 
that  drive  an  individual  to  seek  successively  higher  academic  degrees 
and  military  rank  are  quite  similar  to  those  requisite  to  successful 
performance  as  a  contributor  of  science  or  technology  useful  to  defense. 

During  the  information-collecting  phase  of  Project  HINDSIGHT,  no 
attempt  was  made  to  ascertain  the  reasons  for  the  differences  between 
the  enl i sted  veterans  or  all  veterans  and  the  nonveterans.  However,  a 
plausible  explanation  can  be  conjectured.  First,  it  is  quite  likely 


I  hcil,'  in  .i  number  ui  ui',t's,  cause  and  el  feet  can  lit1  i  n l ••!'<. hanged  ;  lhal 
is,  i  l  may  be  suspected  that  at  least  some  ol  those  who  earned  graduate 
degree',  were,  as  students,  held  by  their  Selective  Service  Boards  in  a 
Jefei red  status  until  alter  graduation.  By  then,  many  effectively 
avoided  military  service  because  id'  marital  status,  relatively  advanced 
age  or  special  employment.  Second,  many  of  the  performers  who  had  their 
advanced  degrees  before  World  War  II  were  draft  deferred  because  of  im¬ 
portant  scientific  and  technical  assignments  vital  to  the  national  war 
effort 

Table  XX.  DEGREE  DISTRIBUTIONS:  VETERANS  AND  NONVETERANS 


Nonveterans 

0.42 

10.fi 

22.9 

56.7 

5.7 

1.7 
1.7 


Degree  Level 

Officer  _ 

Veterans 
Enl i sted 

All 

Postdoctoral 

1.42 

1.02 

1.22 

Ph.  I).  - 

11.1 

5.5 

8.1  ' 

M.S./M.A. 

25.0 

19.6 

21.5 

B.S./B.A. 

55.5 

59.4 

57.3  ,■ 

Some  college 

5,6 

10.3 

8.6 

Technical  school  0  1.4  1,0 

High  school  only  1.4  2.8  2.3 


It  was  noted  in  section  5.7  that  there  is  a  correlation  between 
level  of  academic  education  and  propensity  for  advancing  the  state  of 
the  art  of  mil i tary  science  and  technology  In  a  useful  manner.  The 
arguments  presented  in  the  foregoing  several  paragraphs  suggest  that 
practical  eXper lence  wi th  nil  1 i tary  equipments,  or  perhaps  attendance  at 
one  of  the  mil i tary  services'  schools  in  preparation  for  such  an  assign¬ 
ment,17  tends  to  give  a  measure  of  equalization.  This  explanation  would 
rationalize  the  generally  lower  educational  level  of  the  enlisted  vet¬ 
eran,  who  is  the  one  most  likely  to  have  taken  a  course  at  a  highly 
specialized  technical  service  school.  Further,  it  supports  the  hypothe¬ 
sis  that  a  correlation  in  fact  exists  between  nature  as  well  as  level  of 
education  and  tendency  to  pe’rform  usefully  in  Defense  RED. 

5*8.3  Age  at  Time  of  Contribution— Veteran  vs.  Nonveteran:  An 
examination  of  relative  age  distributions,  veterans  vs.  nonveterans,  at 
the  time  a  contri bution  was  made  produces  Inconclusive  results.  Some 
veterans  completed  all  or  part  of  their  education  before  entering  the 
military  service.  Others  started  undergraduate  or  graduate  work  after 
leaving  the  service.  Among  all  performers,  as  shown  in  Figure  15,  there 
was  considerable  spread  in  age  at  the  time  of  contribution.  The  inter- 
quai rile  range  of  what  approaches  a  Poisson  distribution  is  (-)3  and 


17This  information  was  not  solicited;  because  of  the  known  tendency 
of  the  services  to  give  special  schooling  to  technicians,  however,  the 
possible  impact  of  this  factor  cannot  be  ignored. 


i  *»  *t  .1  j*t*  ij.nl  i  f:  »*\»  f,*«  nf  I  hr  lypitd!  *  l*‘  .i  y  *»*  * 

tin*  vi'ti'i.ni.  line,,  ]l  i*.  i  i",i’.int,ihl«- "  1«»  I  in«l  I  i  f  {  1 1*  -liijni  I  it  .iiii  ilill.-r 
"•  n>  ••  t*n-  pi  lUlm  I  i  ,hh'*,  i>l  vt*!«*i  <tn*.  .if  id  null  v«*  I  i*i  iiii*. . 

,  *1  MnM  i  i  l  v 

Mobility  i  if  *.i  ii*nM  I  ic  ami  Inimical  pi*  i*»onm»  I  can  In.*  dt.“,c  r  I  l*t*»j  in 
■.ewi.il  >1  ii-lorctii  way*. .  limit*  i*.  '*|ji  ntr'.siima  I  iwjlil  I  i  ly  l  hi*  propensity 
ol  an  individual  I  iii  tinssiitij  I  It**  1  ih»m*  I  y  rtnoi|n  i  zed  bi.un  lai  ie*.  ot  vcieli* 
lil  it  tl i m.  i |i I  i nrs  tii  an*a*.  til  lot  liiinliHjy  (sect  inn  5-9.1).  Mui u  familiar 
i-,  tin*  *'  i  nli'iai  yaiil  .Ml  iuna  I  mobility"  associated  with  professionals  * 
iHovi'infiil  tim*  to  another  of  tin*  various  omp  I  uyei  s  ul  sclent  If  it  anti 

technical  expertise  (section  .b.'J.y).  There  is  also  "i it 1 1 aoryuii i/at i on.i I 
mobility,"  as  a  poison  changes  the  naluro  of  his  work  within  a  sinyh* 
organ! /at  i on ,  i  .t*.  ,  change*;  olht*i  t ban  those  Involving  scientific  or 
technical  area*;  of  interest  (section  3). 

Of  iht'so  ihit*t'  forms  of  mobility,  only  Intcroryani /ot ional  movtmient 
is  known  to  have  been  studied  to  any  great  depth.  Shnpero  anti  others 
invest  {gated  the  movements  of  several  thousand  scientists  and .  eng  i  ue«  i  s , 
primarily  of  the  aerospace  research  and  development  common i ly. 1  ^  To  a 
I  inti  ted  extent ,  the  characteristics  of  the  individuals  i  dent  i  i 
throuqh  Project  HINDSIGHT-  can  be  compared  wi t It  the  SRI  findings. 

In  the  following  sections  (5.9.1  through  5.9.ft),  HINDSIGHT  data  are 
further  analyzed  to  continue  testing  the  hypotheses  presented  earlier 
and  to  provide  a  base  line  Tor  future  studies  of  the  behavior  patterns 
of  scientists  and  engineers. 

5-9- I  Professional  Hobl 1 i ty:  This  kind  of  mobility  was  defined 
in  the  foregoing  paragraphs  as  the  propensity  of  an  individual  for 
crossing  the  ioosely  recognized  boundaries  of  scientific  disciplines  or 
areas  of  technology.  A  measure  of  the  professional  mobility  of  the 
identi fled  performers  is  obtained  through  analysis  of  the  matrix  in 
Table  XIX,  a  comparison  of  the  fields  of  technical  activity  represented 
by  the  RXD  Events  with  the  relative  distributions  of  degree  fields  at 
the  B.S./8.A.  level  among  the  performers  associated  with  each  technical 
activity. 

For  purposes  of  analysis,  professional  mobility  is  further  defined 
as  encompassing  the  expectation  that  a  given  individual  will  make  a 
significant  scientific  or  technical  contribution  in  a  field  other  than 
that  for  which  he  was  prepared  by  formal  education.  That  expectation, 
then,  is  measured  simply  as  the  ratio  between  (a)  the  number  of  individ¬ 
uals  who,  because  of  degree  field,  might  normally  be  expected  to  make  no 
contribution  in  a  specific  area  and  (b)  the  total  number  of  individuals 
making  contributions  in  that  area. 


1 ®R&D  Studies  Series  (Menlo  Park,  California:  Stanford  Research 
Institute,  1965" 1966).  ,  c 


f  r  Din  the  same  .raw  data  lh.it  provided  Table  XIX,  a  pr  of  ebb  ional  - 
mobility  index  for  performer*,  with  li.S.  or  B.A.  degrees  is  calculated  to 
lie  0.1/.  Similni  i , ili.ul.it  ions  for  |ieil  ofmer*.  whose  highest  degree  is 
M  S.  .a-  M . A .  result  in  a  mobility  index  ot  0.1 3"-  For  the  Ph.D.  level, 
an  index  ol,  ().t)lt  is  found.  Thus.,  expected  inobi  I  i  ty  at  the  M.S./M.A. 
level  is  more  than  three  times  greater  than  it  is  at  the.  Ph.D.  level; 
am!  about  lour  times  greater  at  the  B.S./U.A.  level. 

The  rank,  ordering  of  this  finding  is  not  at  all  surprising.  The 
realization  that  tin*  data  suggest  that  only  some  A  percent  of  the  Ph.D.'s 
can  be  expected  to  make  contributions  outside  their  originally  chosen 
fields,  however,  suggests  that  Ph.D,  training  within  U.S  universities 
is  quite  narrow. 

in  part,  perhaps,  this  finding — the  lock  of  profess  iona  I  inobi  1  tty 
on  the  part  of  Ph.D.'s — explains  the  earlier  finding  of  a  correlation 
between  DoD-supported  research  in  universities  and  the  defense  orienta¬ 
tion  of  those  universities'  graduates.  The  degree  fields  shown  as  the 
abscissa  of  Table  XIX  are  obviously  quite  broad.  Within  these  fields, 
each  Ph.D.  candidate  selects  some  subfield  for  specialization.  If  he  is 
influenced  in  this  choice  by  a  faculty  adviser  engaged  in  DoD-sponscred 
research,  if  his  research  is  oriented  to  military  uses,  and  if  his 
mobility  (i.e.,  movement)  from  the  subfield  is  1  i  t-tle  greater  than  it  is 
from  the  general  field,  it  is  not  surprising  that  he  is  found  later  to 
be  making  a  useful  contribution  to  science  or  technology  significant  to 
the  DoD.  ' 

These  arguments  further  support  the  first  hypothesis  of  section 
5.7.1  that  there  is  a  positive  correlation  between  the  technical  nature 
and  the  amount  of  formal  education  to  which  an  individual  is  exposed  and 
his  propensity  for  producing  knowledge  that  is  useful  in  defense  weaponry 

Realizing  that  the  faculty  for  an  M.S.  degree  candidate  is,  to  a 
considerable  extent,  made  up  of  the  Ph.D.  candidates  just  mentioned  and 
their  faculty  advisers,  It  is  almost  to  be  expected  that  the  H.S.  candi¬ 
date  would  become  "defense  oriented." 

Why  the  M.S.  degree  from  a  university  where  the  DoD  supports  re¬ 
search  is  relatively  so  much  more  prevalent  among  the  identified  per¬ 
formers  than  the  Ph.D.  degree  is  not  readily  apparent.  One  possibility 
that  cannot  be  discounted  is  that  exposure  to  a  defense-oriented  faculty 
has  caused  a  greater  than  average  percentage  of  graduates  from  these 
universities  to  seek  employment  in  the  defense  industries.  This  matter 
is  researchable;  such  a  project  may  already  have  been  undertaken,  but, 
if  so,  the  findings  have  not  been  widely  circulated. 

Another  but  more  subjective  measure  of  the  lack  of  professional 
mobility  among  the  identified  performers  may  be  seen  by  comparing  Table 
VIII  {a  list  of  the  scientific  and  technical  areas  involved  in  RXD 
Events),  in  terms  of  frequency  of  occurrence,  with  Table  XXI,  which 
shows  the  distribution  of  degree  fields  by  educational  level.  In 
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addition.  Table  XXI  gives  the  current  distribution  ol  the  defense  RtlJ 
work  force  in  the  Los  Angeles  area  as  determined  by  the  Stanford  Research 
Insti  tute. 1,1 

Table  XXI.  DISTRIBUTION  OF  DEGREE  FIELDS  BY  EDUCATIONAL  LLVLL 

HINDSIGHT  sample  Los  Angeles  area 

B.S,  M.S,  Ph.D, _ (all  degrees) _ 

Electrical  engineering  302  33%  192 

Mechanical  engineering  26  16  7 

Physics  15  21  18 

Chemical  engineering  7  5  7 

Chemistry  730 

Aeronautical  engineering  6  5  5 

Mathematics  3  12  14 

Metallurgical  engineering  1  20 

Civil  engineering  1  10 

Industrial  engineering  1  1  0 

Physical  chemistry  0.5  1  7 

Nuclear  engineering  0.5  0  0 

Nuclear  physics  0.5  1  0 

Education  V;  0.5  1  0 

Biology  0.5  0  14 

Organic  chemistry~  0.5  1  2 

Notes:  Columns  do  not  add  to  100  percent  because  of  rounding. 

*(  )  -r-  Included  within  chemistry. 

INS  —  Not  shown  separately. 


With  the  primary  exception  of  the  aeronautical  engineers,  the  dis¬ 
tribution  in  the  Los  Angeles  RC0  complex  is  seen  to  correlate  reasonably 
with  that  of  the  HINDSIGHT  performers.  The  exception  undoubtedly  is 
occasioned  by  the  prevalence  of  the  aerospace  Industry  in  that  area. 
Again,  as  In  Table  VIII,  Table  XXI  offers  some  guidance  on  the  relative 
numbers  of  scientists  and  engineers  (by  discipline)  that  will  be  required 
In  the  near  future,  assuming  no  major  change  in  the  nature  of  the  equip¬ 
ments  to  be  developed  for  the  military  services.. 

$.5.2  Interorganizatlonal  Mobility:  It  was  noted  previously  that 
the  biographical  sketches  of  the  contributors  Identified  through  Project 
HINDSIGHT  were  collected  during  1266  and  were  current  as  of  that  date. 
Thus,. it  is  possible  to  examine  the  interorganizatlonal  mobility  of 


igA.  Shape ro,  R.P.  Howell  and  J.R.  Tombaugh,  The  Structure  and 
Dynamics  of  the  Defense  R&D  Industry:  The  Los  Angeles  and  Boston 
Complexes  (Menlo  Park,  California:  Stanford  Research  Institute,  November 
1965),  p.  24. 
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those  people  over  <j  long  period  of  time — in  some  cases,  as  much  as  i|0 
years.  In  Figure  16,  Lite  sample  of  performers  is  examined  with  respect 
to  total  years  of  piofessional  civilian  experience  vs.  frequency  of 
occurrence.  Half  of  the  sample  had  between  13  and  2k  years  of  experi¬ 
ence.  The  median  length  of  employment  was  shown  to  be  irt  excess  of  16 
years. 

Shapero  and  others  studied  the  engineer/scientist  work  force  of  the 
defense  R&D  industry  in  the  Los  Angeles  and  Boston  areas.''0  Based  on 
the  age  distribution  they  reported  for  the  work  force,  the  median  length 
of  employment  for  their  sample  appeared  to  be  between  8  and  9  years,  or 
about  half  that  found  for  HINDSIGHT  R6D  people.  The  distribution  about 
the  median  for  the  R&D  population  in  the  Los  Angeles  and  Boston  com¬ 
plexes  forms  a  pattern  very  similar  to  that  shown  in  Figure  16,  except, 
of  course,  that  it  is  markedly  displaced  toward  the  origin.  Despite  the 
obvious  considerable  difference  in  average  total  length  of  professional 
employment,  the  HINDSIGHT  performers  appear  to  have  made  fewer  total 
moves.  Comparative  data  are  shown  in  Table  XXII. 


Table  XXII.  INTERORGANIZATIONAL  MOBILITY 


No.  of 
Previous 
Employers 


SRI 

Sample 


HINDSIGHT 

Sample 


Undoubtedly  the  value  of  many  individuals  identified  through  the 
HINDSIGHT  studies  had  long  been  recognized  by  thei r  respective  employers 
It  certainly  can  be  expected  that  whatever  appreciation  these  employers 
expressed,  plus  whatever  satisfaction  the  individuals. derived  from 
knowing  that  their  work  was  being  used,  contributed  to  the  relative 
stability  of  their  employment.  Nevertheless,  it  is  interesting  that  the 
successful  performer  is  not  as  prone  to  change  jobs  as  his  average  pro¬ 
fessional  associate. 


' °Tbid.  ,  pp.  22  and  23. 
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of  professional  civilian  experience 


A  somewhat  different  cause-and-ef feet  relationship  may  be  inferred 
from  tills  apparently  low  mobility,  along  wi  th  tl  data  on  age  at  the 
time  of  contribution  (see  Figure  15).  'Together,  they  suggest  that  the 
person  had  been  with  his  employer  for  some  time  before  making  the  noted 
contribution.  This  could  mean  that,  because  of  his  long  service  with 
the  organization,  he  was  in  a  favorable  pos it  ion  to  have  his  ideas 
recognized  and  exploited.  The  inference  would  he  entirely  consistent 
with  the  finding  (section  4.3-7)  that:  A  high  combined  inventiveness, 
or  ingenui ty ,  and  uti 1 izatlon  rate  are  dependent  upon  the  time  and  space 
coexistence  of  four  primary  factors— the  recogni tion  of  need,  a  source 
of  ideas  in  the  form  of  an  educated  talent  pool,  capital  resources  and 
an  adequate  communication  path  to  potential  users,  ' 

The  general  educational  ievel  of  the  contributor  already  has  been 
established.  Add  to  this  the  fact  that,  through  long  years  of  associa¬ 
tion  with  his  company,  he  had  acquired  special ized  experience  in  its 
technical  affairs  and  had  developed  the  ability  to  interpret  Its  needs 
and  problems.  Then,  only  the  resources  that  one  could  expect  would  be 
made  available  to  a  trusted  employee  are  necessary  to  complete  the  four 
factors  named  in  the  finding. 

On  balance,  it  appears  logical  to  conclude  that  it  is  the  indi¬ 
vidual's  low  interorganizational  mobility  that  leads  to  successful 
performance  rather  than  his  performance  that  leads  to  job  stability. 

5.9.3  Intraorganlzational  Mobi ! i ty :  The  HINDSIGHT  contributors 
show  as  little  propensity  for  moving  wl thin  a  company  as  they  do  for 
moving  between  organizations.  The  information  they  submitted  suggests  ~ 
that,  on  the  average,  each  person  had  held  two  different  positions 
within  his  organization.  In  most  cases,  he  changed  from  a  Job  calling 
primarily  for  activity  in  a  given  scientific  or  technical  field  to  an 
assignment  chiefly  Involving  management  responsibility  in  the  same  tech¬ 
nical  area  or  one  of  somewhat  larger  scope. 

This  finding  appears  to  be  entirely  consistent  with— and  possibly 
helps  to  explain — the  previously  mentioned  finding  that  there  Is  a  very 
high  degree  of  professional  stability  among  the  identified  contributors 
(see  section  5-9.1) •  To  some  extent,  this  stability  may  be  encouraged 
by  the  fact  that  senior  management  may  be  reluctant  to  make  assignment 
changes  that  would  force  the  employee  into  "professional  mobility,"  i .e. 
into  another  scientific  or  technical  field.  Of  course,  it  may  be  that 
management  merely  accedes  to  the  employee's  insistence  that  he  be  al¬ 
lowed  to  remain  within  his  chosen  technical  area  of  work. 

This  is  a  researchable  question,  but  it  was  not  addressed  in  the 
HINDSIGHT  Task  I  study.  A  more  thorough  understanding  of  the  matter 
would  be  useful,  because  it  may  be  that  management  has  inadvertently 
adopted  a  policy  that  mitigates  against  the  fullest  exploitation  of  its 
most  creative  employees. 
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5 , 9 . tj  Education  ami  Responsibility:  Tlie  third  hypothesis  in  sec¬ 
tion  5,7.1  suggested  that  the  correlation  between  level  of  education  am 
propensity  fur  making  utilized  contributions  might  merely  be  based  on 
Lite  fact  that  the  prestige  associated  with  the  higher  academi c,  degree 
held  by  the  individual  placed  him  in  a  favored  position  to  perform  suc¬ 
cessful  ly .  V  . 

A  partial  test  of  the  hypothesis  can  be  made  by  comparing  educa¬ 
tional  achievement  with  other  measures  of  success  within  the  profession 
al  society.  Specifically,  degree  level  can  be  compared  wi th • the  indi¬ 
viduals  hierarchical  rank  within  the  organization.  To  facilitate  this 
test,  six  categories,  or  "responsiblli  ty/authori  ly  levels, "  were  estab¬ 
lished,  as  shown  in  Table  XXIII,  and  the  sample  of  identified  contribu¬ 
tors  was  separated,  by  degree  level,  into  those  classifications  wi th 
the  results  given  in  Table  XXIV. 

.  Table  XXIII.  RESPONSIBILITY/AUTHORITY  LEVELS 


Level 


Assigrcnent 


Division  director 

Branch  director 

Project  manager 

Group  manager 

Professional 
Semi  professional 


Supervision  of  several  branches  related  by 
business  or  object  interests. 

Supervision  of  several  groups  related  by 
discipline. 

Supervision  or  coordination  of  two  or  more 
groups  related  by  project. 

Supervision  of  one  or  more  working-level 
people.' 

Degreed  scientist  or  engineer  at  work  level. 
Technician. 


It  is  obvious  that,  in  absolute  numbers,  the  top  four  responsibili¬ 
ty/authority  levels  are  dominated  by  people  whose  highest  degree  was  at 
the  B.S./B.A.  level.  This  finding  is  partially  a  consequence  of  the 
fact  that  the  largest  percentage  of  the  identified  contributors  Is  In 
the  Bachelor's  degree  group.  The  distributions  of  the  managerial  segment 
of  Table  XXIV  can  be  adjusted  to  compensate  for  unequal  degree-level 
distributions  among  all  performers  (Table  XVIIi),  with  the  results 
shown  in  Table  XXV. 


Table  XXIV.  UNWEIGHTED  Dt  S.TRI  IHJT I  ON  r  lit  DUE  I  VS.  Rl  SPONSI UIL  1TV  LEVLI. 


L ducat ion 

Some 

High 

Re  spons  i  bi  1  i  t^.Leyel 

__Ph.L). 

M.S. 

U.S./B.A. 

college 

school 

Division  director 

26'T 

20V. 

51% 

3% 

- 

Branch  director 

13 

22 

52 

3 

- 

Project  manager 

6 

25 

61 

6 

2% 

Group  manager 

7 

29 

58 

4 

2 

Professional 

11 

20 

61 

6 

2 

Semi  professional 

** 

“ 

10 

45 

45 

Note:  Horizontal  rows 

add  to 

100  percent 

Table  XXV.  WEIGHTED  DISTRIBUTION:  DEGREE  VS.  RESPONSIBILITY  LEVEL 


Responsibility  level 

Education 

Ph.D. 

M.S. 

Some 

B.S./B;A.  college 

High 

school 

Division  director 

43%  ‘ 

33% 

16% 

8% 

_ 

Branch  director 

34 

28 

26 

12 

- 

Project  manager 

13 

26 

25 

21 

15% 

Group  manager 

.15 

32 

24 

14 

15  5  . 

At  the  two  highest  levels  of  authority,  degree  level  and  responsi¬ 
bility  are  seen  to  be  positively  correlated  and  monotonical ly  decreasing. 
Recognizing  that  the  degree  fields  of  these  individuals  were  science  and 
engineering  rather  than  management,  this  finding  does  suggest  that  the 
prestige  conferred  by  the  higher  degree  has  an  influence  in  achieving 
promotion.  Or,  as  in  the  case  of  people  with  military  experience,  it 
may  be  that  whatever  personal  characteristics  drive  one  to  seek  higher 
degrees  have  much  in  common  with  those  that  impel  one  to  seek  positions 
of  responsibility. 

The  distributions  at  the  levels  of  project  and  group  managers  are 
not  at  all  inconsistent  with  either  or  both  Interpretations.  The  data 
on  responsibility/authority  levels  relate  to  the  contributors'  current 
positions,  not  thei r  pos i tions  at  the  time  of  the  RXD  Event  involved. 
Further,  the  length  of  time  that  most  of  those  individuals  had  been 
employed  suggests  that,  in  the  preponderance  of  cases,  they  were  at  or 
near  the  highest  positions  of  authority  to  be  expected.  Thus,  Table  XXV 
demonstrates  that  there  is  a  weeding-out  process  and  that  the  person 
holt  ng  the  higher  degrees  can.  expect  commensurate  rewards. 

It  is  clear,  however,  that  this  analysis— intended  to  test  the 
correlation  between  degree-conferred  prestige  and  propensity  for  making 
militarily  useful  contributions  to  science  and  technology — results  in 
equivocal  findings.  Prestige  may  be  a  factor,  but  it  does  not  appear  to 
be  truly  s:gr.;  i  icant. 


Further  analysis  of  the  biographical  sketches  suggests  that  inter- 
organizat ional  stability  also  correlates  positively  with  responsibility/ 
authority  level — ,it  least,  anioiKj  the  identified  successful  performers. 
Table  XXVI  displays  the  relationship  between  number  of  previous  employers 
and  hierarchical  level  of  responsibility  achieved  by  ig6£>,  Only  manage¬ 
ment  levels  are  considered. 


Table  XXVI.  RESPONSIBILITY/AUTHORITY  LEVEL  VS. 

NUMBER  OF  PREVIOUS  EMPLOYERS 


Responsibility/ 
Authority  Level 

No. 

of  Previous  Emplo 

yers 

0 

1 

2 

3 

4 

5  or 
more 

Division  director 

28% 

19% 

28% 

18% 

4% 

3% 

Branch  director 

32 

21 

22 

6 

10 

9 

Project  manager 

33 

26 

17 

10 

.  9 

3 

Group  manager 

34 

33 

11 

14 

5 

3 

Note:  Percentile  by  row. 


Comparison  of  the  information  in  Tables  XXV  and  XXVI  suggests  that, 
at  the  division-director  level,  some  tradeoff  is  accepted  between  the 
Ph.D.  degree  and  number  of  previous  employers.  That  is,  at  this  highest 
level  the  Ph.D  degree  is  somewhat  more  important  than  interorganization- 
al  stability  as  a  criterion  for  promotion.  This  is  additional  evidence 
that  prestige  associated  with  degree  level  correlates  with  the  attainment 
of  positions  of  higher  responsibility  and  authority.  It  is  noted,  how¬ 
ever,  that  this  particular  finding  Is  not  necessarily  relevant  to  the 
hypothesis  concerning  nature  and  level  of  education  and  propensity  for 
useful  contribution. 

5.10  Marital  Status  •, 

For  the  current  engineering  and  scientific  work  forces  of  the  Boston 
and  Los  Angeles  R£D  complexes,  Shapero  and  others  reported  that  70.9  per¬ 
cent  of  the  males  were  married,  27.3  percent  were  single,  and  1.8  percent 
were  divorced  or  separated  at  the  time  they  were  hired.21  The  somewhat 
higher  average  age  of  the  HINDSIGHT  contributors  at  the  time  their  bio¬ 
graphical  sketches  were  collected  (A3  vs.  36  years)  precludes  a  usuful 
comparison.  Nevertheless,  the  differences  are  great  enough  to  warrant 
reporting.  The  distribution  among  the  HINDSIGHT  contributors  was  found 
to  be; 

Married - - — - — 94.0*  Widowed-^— - 0,4t 

Single - - - 4.9%  Ever  divorced — 4.0% 

Divorced  or  separated--  Q.7% 


?xIbid. ,  p.  26. 
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It  is  pi 'i  atari  ly  the  difference;  in  the  "di  voiced  or  separated" 
figures,  despite  the  relatively  small  percentage  in  either  case.,  that 
may  be  mos  t  interest  i  ng  .  The.  repealed  I  y  noted  tendency  toward  stability 
—  in  terms  of  areas  of  professional  interest,  in  terms  of  employers,  in 
terms  of  positions  within  an  organisation — is  further  evidenced  by  the 
apparently  greater  marital  stability  of  the  successful  contributor. 

^.11  Continued  Postgraduate  Education 

In  addition  to  formal  education  leading  to  the  award  of  a  degree, 
many  of  the  contributors  reported  attending  one  or  more  postgraduate 
courses.  Well  over  50  percent  of  the  individuals  participated  in  short 
courses  or  lectures  series  sponsored  by  their  employers.  The  available 
information  on  these  courses,  which  varied  in  length  between  a  few 
hours  and  a  few  weeks,  is  inadequate  as  a  basis  for  analysis  of  the 
quality  or  significance  of  the  instruction.  A  somewhat  smaller  group 
reported  that  they  had  taken  formal  courses  offered  by  recognized  uni¬ 
versities  ei.ther  on  or  off  campus.  Table  XXVII  presents  a  distribution 
of  the  1  atter  i  nforination  in  terms  of  the  highest  degree  held  by  the 
reporting  person  and  by  the  general  nature  of  the  course. 

Table  XXVII.  POSTGRADUATE  EDUCATION 


t 

\  Type  of  Course 

Ph.D. 

M.S. 

B.S. 

' 

F 

Technical 

.  6* 

14% 

10% 

Administrative 

r.  •.  ^ 

0 

4% 

1% 

In  some  cases,  the  individual  had  delayed  taking  a  formal  course 
for  as  much  as  20  years  after  receiving  his  last  degree.  The  average 
delay  appears  to  be  about  7  years,  and  the  median,  about  5  years.' 

No  comprehensive  Information  concerning  the  practices  of  the 
defense-oriented  RSD  community  Is'  known  to  be  available.  There  are 
some  data  on  individual  organizations  and  on  the  entire  national  scien¬ 
tific  and  engineering  community,  however,  that  offer  a  limited  basis 
for  comparison. 

The  National  Science  Foundation22  estimates  that  about  5  percent  of 
the  country's  scientists  and  engineers  are  currently  taking  part-time 
university  work.  From  the  NSF  data,  it  Is  not  possible  to  determine  the 
total  percentage  that  continue  with  postgraduate  education  at  one  time 
or  another  over  the  years. 


22Zola  Bronson,  National  Science  Foundation,  private  correspondence, 
August  1967. 
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At  the  individual  organ  i/.U  ion.il  level,  1 ,  M,  Kuhln'* 1  report-,  thui 
by  1 967  mure  than  40  percent,  of  the  professionals  at  the  Langley  Research 
Center,  National  Aeronautics  am!  Space  Administration,  hud  taken  at  least 
one  formal  university  course  under  the  auspices  of  NASA's  continuing  edu¬ 
cation  program,  with  approximately  one-third  of  the  staff  participating 
in  any  recent  year.  At  the  Army's  Harry  Diamond  Laboratories,  86  percent 
of  the  professional  staff  completed  courses  of  at  least  one  semester's 
duration  during  the  period  1964-1967.-"' 

By  any  of  these  measures,  the  identified  contributors  to  RXD  Events 
are  markedly  in  the  minority. 

One  can  speculate,  of  course,  that  the  contributors  are  leaders  in 
their  fields,  and  therefore  are  more  likely  to  develop  information  to  be 
taught  their  peers  than  to  learn  it  in  a  classroom.  Or  it  could  be  that 
the  contributors  tended  to  travel  so  much  in  the  course  of  their  work 
that  taking  even  port-time  classes  was  impracticable.  Whatever  the 
reason,  it  is  apparent  that  these  valuable,  creative  people  were  not 
given  to  exploiting  the  opportunities  for  continued  postgraduate  educa¬ 
tion  that  are  offered  by  most  of  the  larger  universities. 

5.12  Summary  and  Discussion 

These  additional  findings  combine  to  present  extraordinarily  con¬ 
sistent  patterns.  Host  of  the  scientific  and  technical  tngenuity  and 
innovation  leading  to  modern  weapon  systems  is  found  in  a  very  conser¬ 
vative,  almost  routine  environment.  For  example,  nearly  half  of  the 
advances  came  about  as  a  consequence  of  what  the  performers  considered 
to  be  routine  assignments  (Table  X).  The  persons  credited  with  the 
advances  give  evidence  of  extreme  conservatism.  In  comparison  with 
others  in  their  professional  society,  they  tend  more  to  remain  in  the 
scientific  or  technical  areas  in  which  they  were  educated,  to  stay  on 
the  same  Job  with  the  same  employer,  and  to  be  satisfied  with  the  level 
of  education  attained  before  they  first  sought  profess ional  employment; 
they  even  tend  to  have  more  stable  family  lives.  The  chief  possible 
departure  from  this  otherwise  consistent  pattern  is  their  apparent  will¬ 
ingness  to  move  from  thei r  chosen_  techn! cal  fields  Into  management 
positions  when  they  were-  relatively  young. 

To  a  considerable  degree,  this  may  explain  why  comparatively  few  of 
the  technological  Events  were  found  to  be  based  on  the  results  of  recent 
scientific  advances.  For  Is  It  likely  that  individuals  with  such  stable 
and  conservative  traits  would  delve  Into  what  is,  to  them,  the  unknown 
for  the  solution  to  a  problem?  Certainly  not.  If  such  a  digression 


23I.M.  Rubin  and  H.G.  Morgan,  A  Projective  Study  Toiku’ds  Continuing 
Education  (Boston:  Sloan  School  of  Management,  Massachusetts  Institute  of 
of  Technology,  1 9o7) . 

24Maurlce  Apstein,  Harry  Diamond  Laboratories,  private  correspon¬ 
dence,  August  1967. 


could  be  avoided.  If  the  characteristics  of  people  making  significant 
technological  contributions  in  areas  other  than  weaponry  are  equally 
conservative,  there  is  little  wonder  that  new  scientific  findings  move 
so  slowly  into  everyday  engineering. • 


2 5 Jacob  Schmookler,  Invention  and  Economic  Growth  (Cambridge: 
Harvard  University  Press,  19^6). 
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Preceding  Page  Blank 


6,  RESEARCH  ENVIRONMENT  FOR  HIGH -PAYOFF 

6.1  RDTfcE  Envi  ronments 

Management  has  tended  to  create  different  envl ronments  for  funding 
control  and  the  decision  process  in  the  several  phases  of  the  RDTcE 
cycle.  In  addition,  it  is  a! leged.  that  significant  intellectual  and 
sociological  differences  may  be  found  between  the  classic  organizational 
structures  identified  os  "Government  In-house,"  "university-associated" 
and  "industrial"  laboratories.  Presumably  some  one  combination  of  the 
factors  making  up  the  various  environments  should  be  more  effective  than 
others  for  fostering  creativity  and  the  utilization  of  its  products. 


One  of  the  primary  stated  purposes  of  Project  HINDSIGHT  was  to 
identify  management  factors  that  constructively  affect  the  productivity 
of  a  scientific  or  technical  research  program.  It  is  emphasized  that 
the  factors  sought  were  those  associated  with  the  combination  of  creativ¬ 
ity  and  use  of  results.  Quite  possibly,  the  optimum  environment  repre¬ 
sents  a  compromise;  it  may  not  be  the  best  situation  for  scientific 
creativity  alone,  or  the  best  for  innovation. 

An  immediate  observation  based  on  one  of  the  HINDSIGHT  findings 
(see  section  4.3.1)  is  that  the  broad  categorical  differences  between 
Government,  university  and  Industrial  laboratories  do  not  markedly  in¬ 
fluence  productivity  In  terms  of  the  emphasized  combination — creativity 
and  result  usage.  Similarly,  the  study  shows  that  productivity  is  not 
restricted  to  the  environments  associated  with  the  ReD  categories  of 
either  research  or  exploratory  development. 

Based  on  the  686  RXD  Events  on  which  pertinent  data  are  available, 
the  percentage  distributions  among  the  Defense  ReD  categories  were  found 
to  be: 


Research - - - 9% 

Exploratory  deve lopnient — 28% 

Advanced  development - -40? 

Engineering  development— 22? 

Management  and  support — >1? 

A  considerable  number  of  Events  occurred  before  7  June  1962,  the 
date  on  which  these  categories  were  formally  established.  Those  Events 
were  categorized,  Insofar  as  possible,  through  analysis  of  the  circum¬ 
stances  In  which  they  came  about.  When  there  was  significant  doubt, 
the  Event  was  ignored  in  calculating  percentage  distributions.  Thus, 
the  distribution  is  only  roughly  descriptive  of  the  situation  and  is  of 
interest  primarily  because  the  peaking  occurs  in  the  advanced  develop¬ 
ment  category.  Obviously,  creativity  and  the  Imaginative  application 
of  scientific  principles  can  be  found  in  work  relating  to  every  phase  of 
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tin.'  RDTt.L  cycle.  1*1  mlucl  i  v  i  ly  is  s  i  gnil  u  an  t  ly  ,il  1  c-i.  t  c-d  cillu-i  by  I  «r. 
tors  common  to  each  of  the  oryani/.U  ionul  and  budge t  i n<j  (.,iic(|i.rici 
cons iik-rod  hero  or.hy  il if IV rout  sots  ol  factors  that  apply  within  noth 
category. 

Thi s—s t  inly  was  not  doep  enough  to  sense  dilleient  sets  ol  factors 
—  if,  in  I  act  ,  they  do  exist .  Subsequent  par agraphs  consider  the  find 
■i  jig's  wit  h  regard  to  apparently  significant  environmental I  factors.  The 
several  classes  of  research,  from  undirected  scientific  research  through 
research  in  technology,  are  treated  in  turn,  and  the  findings  are  dis¬ 
cussed  in  relation  to  pert  incut  management  factors  that  seem  to  be 
controllable  by  policy. 

Based  on  the  methodology  employed  in  Project  HINDSIGHT,  only 
successes  were  studied.  It  cannot  be  concluded,  therefore,  that  this 
"most  effective"  environment  will  ensure  success;,  failures  have  happened 
and  probably  wi 1 1  continue  to  occur.  Because  other  patterns  of  manage¬ 
ment  have  failed  to  exhibit  as  high  a  utilization  rate,  however,  it  must 
be  assumed  that  their  efficacy  was  lower  and  their  failure  rate*  at  least 
si igh.tly  higher. 

To  this  point,  payoff  has  been  considered  only  as  the  recognized 
use  of  results  proceeding  from  the  research  effort  on  a  military  system. 
Other  forms  of  payoff  were  observed  in  the  course  of  Project  HINDSIGHT, 
but  the  establishment  of  their  relative  value  to  a  mission-oriented 
agency  such  as  the  DoD  is  beyond  the  scope  of  this  study.  It  Is  clear, 
however,  that  they  do  exist  and,  by  and  large,  tend  to  be  associated 
wi th  general ly  undi rected  research  in  science.  (See  section  Z  on  HIND¬ 
SIGHT  objectives,  strategy  and  methodology.) 

6.2  Research  in  Science 

6.2.1  Undirected  Basic  Research:  There  is  very  ! i ttle  evidence 
that  ideas  spawned  during  recent  basic  research,  particularly  in  the  so- 
called  undirected  basic  research  In  science,  as  opposed  to  directed 
research  (Tables  HI  and  IV) ,  manifest  themselves  In  improved  weapon 
systems.  In  the  fields  of  statistical  analysis,  other  aspects  of  infor¬ 
mation  theory,  nuclear  physics  and  polymer  chemistry,  a  very  few  exam¬ 
ples  have  been  found  in  which  payoff  was  identified  In  a  system. 

Nevertheless,  it  has  been  seen  that,  wherever  there  was  a  payoff  of 
basic  scientific  research  in  terms  of  use  in  systems,  its  value  was 
comparatively  great.  Examples  are  found  in  all  solid-state  electronic 
systems,  nuclear  weapons  and  power  suppl ies ,  Information  processing  in 
computers  and  radars,  and  the  application  of  statistical  sampling  in 
quality-control  techniques. 

The  greater  payoff  of  undi rected  basic  research  in  science  identi¬ 
fied  in  HINDSIGHT  studies  has  been  observed  in  forms  other  than  direct 
weapon-system  application.  In  terms  of  numbers,  the  gain  has  been  in 
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the  training  of  scientists  and  engineers  who  performed  the  directed  re¬ 
search  in  basic  science  or  In  technology  that  led  to  the  new  weapon 
systems.  The  technique  of  investigation,  the  so-called  scientific  ap¬ 
proach,  that  has  been  developed  and  propagated  by  the  universities  has 
had  a  tremendous  observable  impact. 

section  !>.7  demonstrated  how  valuable  university-trained  scientists 
have  been  to  the  Department  of  Defense  — in  particular,  those  trained  In 
universities  that  had  defense-oriented  research  programs.  When  the  DoD's 
recognized  dependence  on  schooled  scientists  and  engineers  is  considered, 
along  with  the  fact  that  in  a  typical  year  (FY  1965,  for  example)  approx¬ 
imately  ’6  percent?b  of  the  nation's  sclent i fic  and  engineering  talent  is 
engaged  work  that  is  directly  or  indirectly  Defense  supported,  the 
magnitude  of  the  payoff  may  be  appreciated. 

The  second  very  useful  product  of  undirected  basic  research  is  the 
instrumentation  developed  by  the  scientists  In  their  quest  for  knowledge. 
If  there  Is  a  characteristic  di fference  between  undirected  and  directed 
research  in  science.  It  is  probably  that  the  former  examines  all  possible 
aspects  of  a  phenomenon  in  detail,  while  the  latter  tends  to  be  more 
restricted  in  scope,  focusing  on  the  apparently  most  pertinent  aspects, 
in  their  desire  to  observe  in  totality,  the  performers  of  undirected 
basic  research  have  developed  instrumentation  that  is  exotic  and  precise. 
The  resulting  devices  were  identified  through  Project  HINDSIGHT  as  they 
became  the  tools  of  the  applied  scientist  and  the  engineer. 

The  nature  of  a  third  payoff  of  undirected  research  is  suspected 
but  has  not  yet  b>en  well  established.  Often  the  candidate  for  a 
Master's  degree  In  science  or  for  a  Ph.D.  bases  his  thesis  or  disserta¬ 
tion  oh  research  Into  a  particular  characteristic  of  a  device  or  mate¬ 
rial.  If  the  results  of  this  research  in  any  significant  amount  are 
collated  by  the  publishers  of  the  commonly  used  engineering  handbooks , 
this  third  form  of  payoff  is  established.  This  matter  is  being  investi¬ 
gated  as  part  of  Project  HINDSIGHT'S  more  detailed  s.tudles  of  management 
factors.2'  ' 

6.2.2  Directed  Basic  Research:  No  sharp  1 1 nw  of  demarcation  is 
found  between  theoretical,  undirected  research  in  science  and  Its  di¬ 
rected  counterpart.  .  Instead  there  is  an  almost  continuous  spectrum, 
i  rom  the  case  in  which  the  scientist  undertakes  a  particular  line  of 
investigation  "because  it  looked  interesting"  to  a  ventuie  that  is 
totally  responsive  to  the  request  of  an  outsider. 

?6Estimated  from  the  ratio  of  Defense  spending  to  total  national 
expenditures  for  RSD,  Reviem  of  Data  on  Science  Resources  {Washington, 
D.C.;  National  Science  Foundation,  NSF  65-11,  May  1965),  J_»  M. 

2 ’Robert  C.  Mills,  Liaison  Activities  at  RSD  Interfaces — A  Model ; 
Some  Empirical  Results  and  Design  Considerations  for  Further  Study 
(Evanston,  Illinois;  Northwestern  University,  June  1967) . 
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Most  of  the  scientific  research  supported  by  the  OoO  is  justified 
t>y  some  lationale  and  is  typically  referred  to  as  "relevant  The  i - 
ys.s  of  project  HINDSIGHT  data  on  the  use  of  results  of  directed  scien- 
t  fie  research  offers _ support  for  the  concept  of  relevancy  and  suggests 
<t  a  i  goious  definition  of  relevance  is  essential.  Where  results 
were  -applied  the  research  task  tended  to  be  relevant  to  a  very  specifir 
technology  already  being  used  in  a  cruder  form.  |n  a  sense,  recent 
scientific  research  that  has  been  found  significant  to  improved  weapon 
££2"!*  t0°k.  the  form  of  a  "mop-up"  effort.  Engineers  were  employing  a 
technology  with  some  degree  or  success  but  didn't  understand  in  detail 

and  eventual j  W^rked ‘  Scientific  analysis  led  to  a  better  understanding 
and  eventually  to  greater  exploitation  of  the  technology. 

Examples  of  the  return  on  investment  'in  scientific  mop-up  research 
were  found  i n  every  weapon  system  studied.  Problems  of  extracting 
information  from  contemporary  radars  led  to  filter-theory  research 

7em?LanrtUrn,-,edIt0  f?r  ",ore  caPable  radars.  Propeller-noise  prob- 
nwli  !  •t'°rthe0rV  studies  that  generated  th.e  knowledge 

needed  for  designing  less  noisy  propellers  for  torpedoes.  Problems  of 
conbustion  mstabijity  in  rocket  and  turbine  engines  furnished  the 
rationale  for  pertinent  scientific  research. 

Relevant  research  probably  results  in  a  high  payoff  in  utilization 
for  wo  * nterrelated  reasons:  (1)  The  scientific  research  was  known  ?o 

and  areVs“93ested  by  a  problem  in  the  associated  technology; 

and  (2)_a  ready  market  for  any  new  knowledge  generated  was  known  to 
ex  st,  for  in -advertising  their  problem  the  engineers  identified  them- 
seives  as  potential  users,-  Profitable  directed  research,  as  described 

0  lrtS  •’W*  r!qU’reS  a  fairly  direct  line  of  communica¬ 
tion  between  the  engineer  and  the  scientist.  J 

.  6-2-3  Research  in  Materials:  Another  class  of  research  in  science 

observed  in  the  Project  HINDSIGHT  studies  has  had  an  equal  or  greater 
payoff.  Wei Tover  half  the  identified  technological  advances  clearly 
occurred  ,n  the  absence  of  new  scientific  ideas.  Almost  all  ,■  however 
depended  upon  the  existence  of  new  information  on  characteristics  of  ’ 
materials  or.  the  operation  of  devices  such  as  the  transistor.- - The  class 
of  research  that  leads  to  new  materials,  to  measurements  of  those  mate- 
rials  characteristics,  and  eventually  to  the  publication  of  pertinent 
data  has  been  of  primary  value. 

...  From  tb®  pragmatic  view  of  a  mission-oriented  agency,  fairly 

!«w'x!e!Ik  criteria  for  the  class  of  research  leading  to  reference  texts 
and  handbooks  can.  be  established.  The  producers  of  the  documented  in¬ 
formation  or  their  managers,  must  remain  aware  of  the  technical  prob¬ 
lems  of  the  engineering  community.  Further,  deliberate  attempts  must  be 

T"6  w  !rtlC,pate  'nforrnation  needs,  particularly  as  the  engineer  begins 
to  push  the  state  of  an  art  to  its  limit.  u 

Section  5. 1.2.2  discussed  the  Importance  of  identifying,  publishing 
and  disseminating  information  regarding  the  characteristics  of  new 
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rtialerials.  In  this  particular  example,  the  information  is  amenable  to 
presentation  in  a  'handbook','  But  t  lit*  concept  involved — that  of  deliber¬ 
ately  investigating  natural  phenomena  and  reporting  the  results  in  what¬ 
ever  form  is  required  for  maximum  utility  to  the  engineer — can  Be  applied 
with  equal  validity  in  any  scientific  discipline. 

6.2.4  General  Observations:  It  must  be  remembered  that  all  identi¬ 
fied  RXO  Events  have  two  common  characteristics;  First,  as  a  consequence 
of  research  in  science  or  In  technology,  some  new  knowledge  was  made 
available.  Second,  this  new  knowledge  was  employed  by  an  applications 
engineer  in  the  design  or  development  of  a  weapon  system  or  piece  of 
military  equipment. 

None  of  the  findings  or  observations  presented  in  this  report 
should  be  Interpreted  as  claiming  that  undirected  research  In  science 
during  the  past  20  years  has  not  produced  a  great  deal  of  useful  infor¬ 
mation.  Rather,  the  findings  suggest  that  the  transfer  of  undirected 
basic  research  to  technology  for  weapon-system  development  can  require 
20  years  or  more.  This  transfer  of  the  scientific  base  may  be  Influenced 
by  early  recognition  of  a  need  or  technological  opportunity,  by  effective 
coupling  between  the  scientific  and  technical  communities,  and  other 
variables  that  require  further  definition  and  analysis.  ‘ 

The  data  from  this  study  indicate,  however,  that  there  does  exist  a 
shorter  time  span  between  scientific  discovery  in  directed  basic  research 
and  its  practical  uti  llzati on  than  between  undi  rected  basic  research  and 
its  practical  utilization;  this  should  be  expected.  The  median  time  be¬ 
tween  the  occurrence  of  scientific  events  Identified  In  the  directed 
basic  research  category  and  the  incorporation  of  the  resulting  new  knowl¬ 
edge  into  the  design  of  a  weapon  system  was  nine  years.  Thus,  it  is 
evident  that  a  motivation  toward  system  application  Influences  the  time 
for  transfer  of  basic  research  events  into  system  development.  This 
observation  in  no  way  derogates  the  continuing  requirement  for  expanding 
the  frontier  in  the  scientific  disciplines. 

It  is  clear  that,  on  a  time  scale  of  50  years  or  more,  undirected 
scientific  research  has  been  of  immense  value.  Without  basic  physical 
science,  we  could  scarcely  have  developed  the  modern  technologies  of 
nuclear  energy  or  communications  or  the  current  electrical  and  chemical 
Industries.  None  of  the  Identified  scientific  Events  would  have  been 
possible  without  the  use  of  one  or  more  of  the  great  systematic  theories 
— classical  mechanics,  thermodynamics,  electricity  and  magnetism,  rela¬ 
tivity  and  quantum  mechanics.  These  theories  also  played  an  important 
role  in  many  of  the  technological  Events.  For  example,  If  one  were  to 
count  how  many  times  Newton's  laws,  Maxwell's  equations  or  Ohm's  law 
were  used  in  the  systems  studied,  the  total  would  far  outnumber  the 
recent  RXD  Events  identified. 

In  less  than  5  percent  of  all  identified  RXD  Events,  scientists  or 
engineers  were  called  in  to  "make  someone  else's  solution  work,"  In 
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85  percent  of  the  cases,  a  fundamental  problem  was  presented  to  the 
creative  individual  or  group  and  a  new  and  Successful  solution  was  con¬ 
ceived.  The  evidence  is  so  overwhelming  that  no  question  should  remain 
regarding  the  role  of  the  scientist  or  research  engineer  vis-&-vis  the 
apol fcations  engineer;  neither  can  be  subservient  to,  or  unaware  of,  the 
other.  Each  performs  best  when  free  to  cope  with  the  fundamental  prob¬ 
lem.  Any  environment  that  enhances  coordination  would  encourage  the 
higher  payoff  of  research.  These  general  observations,  by  suggesting 
specific  fruitful  activities,  implicitly  recognize  this  fact. 

6. 3  Research  in  Technology 

6.3-1  Subclasses:  General  and  Restricted:  Of  the  identified  RXD 
Events,  91  percent  are  reasonably  classified  as  research  In  technology. 
The  characteristic  that  distinguishes  that  kind  of  effort  from  the  equal¬ 
ly  Important  but  somewhat  more  pedestrian  work  of  applications  engineer¬ 
ing  is  the  relative,  amount  of  technological  risk  involved.  Before  an 
RXD  Event  could  be  so  classified  under  Project  HINDSIGHT,  there  had  to 
be  evidence  that  the  performers,  though  confident  in  their  prospects, 
realized  that  success  was  not  a  reasonable  certainty.  More  specifically, 
experiments  to  establish  feasibility  must  have  been  designed  and  actually 
performed.  /  ■"  ? 

Again,  as  in  the  case  of  directed  scientific  research,  two  signif¬ 
icant  subclasses  of  highly  productive  Utilized  research  in  technology 
were  observed,  both  involving  before-the-fact  recognition  of  a  techno¬ 
logical  problem;  They  differ  primarily  in  the  manner  in  which  the 
problem  area  is  identified.  For  purposes  of  classification,  they  are 
described  in  this  discussion  as  "general"  and  "restricted"  technological 
research. 

General  technological  research:  In  the  first  subclass,  the 
performer's  attention  was  focused  on  a  broad  spectrum  of  functionally 
similar  general-purpose  technological  building  blocks.  Outstanding 
examples  included  work  supported  by  the  DoD  laboratories  that  led  to  a 
multiplicity  of  transistors  with  selective,  highly  predictable  charac¬ 
teristics  and  economical  techniques  for  their  manufacture  and  production; 
small  compatible  passive  electronic  devices;  ferrous  and  nonferrous 
structural  materials  and  fabrication  techniques;  liquid  and  solid  rocket 
propellants;  and  explosives. 

Restricted  technological  research:  The  second  subclass 
covered  the  development  of  devices  or  techniques  with  fairly  restricted 
applications.  It  included  such  items  as  the  Investigation  of  missile- 
launcher  design,  the  development  of  engine  and  missile-motor  components, 
and  specific  missile-guidance  components  of  inertial  quality. 

In  terms  simply  of  the  number  of  RXD  Events  identified  in  each  sub¬ 
class,  30  percent  of  all  the  technological-research  Events  studied  were 
general,  and  70  percent  were  restricted.  (The  matter  of  the  subclasses' 
relative  value  is  discussed  in  section  6.3.4.) 


6.  j,2  Management  Aspects:  Differentiating  between  the  subclasses 
from  a  management  viewpoint,  we  find  in  the  "general"  subclass  a  low 
risk  that  research  results  will  not  be  used  as  long  as  the  product  in 
any  way  represents  an  advance  in  technology.  But,  without  very  close 
coordinat ion  or  centralized  management,  there  Is  a  high  risk  of  duplica¬ 
tive  research  efforts.  In  the  "restricted"  subclass,  on  the  other  hand, 
there  is  a  comparatively  low  risk  of  duplicative  efforts  and  a  high  risk 
of  nonut t 1 ization  unless  the  applications  engineer  is  aware  of  the  re¬ 
sults  and  they  very  closely  satisfy  his  requirements. 

The  ideal,  efficient  environment  is  one  in  which  performers  of 
restricted  technological  research  and  applications  engineers  are  geo¬ 
graphically  or  organizationally  associated.  Thus,  general  research  can 
be  performed  most  efficiently  under  centralized  management ,  and  restric¬ 
ted  research,  under  decentralized  management. 

The  value  of  decentral i zed  management  for  the  restricted  subclass 
is  confirmed  historical !y  by  observing  the  absolute  magnitude  of  the 
utilized  results  of  technological  research  in  the  course  of  engineering 
development.  From  20  to  30  percent  (varying  among  the  weapon  systems 
studied)  of  the  requisite  new  information  in  restricted  technological.  . 
research  that  was  used  had  been  generated  during  engineering  development, 

6.3.3  Kinds  of  Payoff:  The  examples  of  payoff  from  general  tech¬ 
nological  research  form  a  readily  distinguishable  pattern.  The  most 
obvious  characteristic  is  that  the  technology  tends  to  have  peculiarly 
military  flavor — or,  at  least,  at  the  time  the  Event  occurred,  interest 
In  the  technology  was  found  primarily  within  the  Military  Services.  But 
most  of  the  utilized  technological  research  In  guidance,  radar  and 
rocket  propulsion  was  directed  and  performed  by  individuals  who  were 
concerned  more  with  the  technology  than  with  the  development  of  any 
specific  end-item  system. 

in  each  case,  however ,  the  performers  were  sufficiently  aware  of 
the  technology's  deficiencies  in  terms  of  foreseeable  requirements  of 
future  systems.  This  awareness  extended  to  the  knowledge  of  quite 
specific  design  criteria  that  were  desired.  For  example,  those  groups 
pushing  microwave  power  tubes  for  radar  knew  more  than  the  simple  fact 
that  devices  with  higher  output  would  be  wanted.  They  had  a  quanti¬ 
tative  notion  of  just  how  much  higher  the  output  would  have  to  be. 

In  retrospect,  It  Is  clear  that  this  quantitative  information  must 
have  enhanced  the  realized  research  efficiency,  If  only  oy  automatically 
ruling  out  any  technological  approaches  (even  i f  otherwise  successful) 
whose  potential  was  inadequate  to  satisfy  the  criteria.  Examples 
(other  than  the  amplitron  microwave  power  tube  already  mentioned)  are 
the  hydrogen  thyratron,  inertial-quality  guidance  components,  liquid  and 
solid  propellants,  rocket-motor  cases  and  magnetic  sensors. 
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•  A  b  I  ighl  ly  :iii  f  ferent  illustration  of  utilized  technological  research 
is  found  in  the  development  of  tantalum  capacitors  and  hjgh-cpre- 
permeability  inductors.  It  was  obvious  to  key  personnel  that  the  small¬ 
ness  of  the  transistor  could  not  be  fully  exploited  if  the  size  of  the 
circuit  chassis  were  dictated  by  the  use  of  comparatively  large  conden¬ 
sers,  coils  and  transformers.  Because  these  people  and  their  close 
associates  were  vitally  interested  in  reducing  the  size  of  electronic 
equipment,  technological  research  to  that  end  was  successfully  pursued. 

It  may  be  that  other  research  engineers ,  more  remote  from  applica¬ 
tions  engineering,  also  recognized  the  problem  and  achieved  technological 
success  along  other  approaches.  If  so,  no  evidence  of  those  results' 
utilization  was  found  in  the  HINDSIGHT  study,  there  may  have  been  tech¬ 
nological  success,  but  the  results  were  not  “sold,"  and  the  research 
engineer's  remoteness  from  the  applications  engineer  cannot  be  discounted 
as  the  reason  for  it.  / 

In  over  93  percent  of  the  identified  Evehts  in  the  technological 
research  category,  available  information  supports  the  conclusion  that 
continuing  interaction  between  research  and  applications  engineers  Is 
essential  to  a  productive  .tech  no  logical  research  program. 

Incidentally,  such  examples  as  the  microwave  power  tube,  the  hydro¬ 
gen  thyratron  and  the  tantalum  capacitor  point  out  a  very  valuable  con¬ 
tribution  by  the  technical  personnel  of  the  DoD  laboratories.  In  each 
case,  the  greater  part  of  the  technological  research  by  far  was  accom¬ 
plished  in  private  industry,  generally  under  contract  with  one  of  the 
Military  Departments.  The  work  was  distributed  widely  In  time  and 
place.  The  only  names  that  appear  with  any  regularity  as  having  been 
involved  technically  are  those  of  a  few  Individuals  from  the  Army 
Electronics  Laboratories  at  Fort  Monmouth,  New  Jersey,  the  Navy  Elec¬ 
tronics  Laboratory  at  San  Diego,  California,  and  the  Air  Force's 
Avionics  Division  at.  Wnght-Patterson  Ai  r  Force  Base,  Ohio.  It  is 
clear  that  these  few  people  provided  the  continuity  and  effective 
guidance  that  resulted  in  the  high  payoff  of  technological  research. 

6-3.9  Relative  Value  of  Subclasses:  It  has  been  noted  that  30 
percent  of  the  technological  Events  fell  into  the  general  subclass. 

According  to  the  analytical  technique  used  i li  Project  HINDSIGHT,  it 
is  assumed  that  each  Event  deserves  equal  weight,  or  value.  This 
assumption  is,  in  fact,  valid  only  In  the  context  of  a  single  weapon 
system.  In  that  case,  because  greatly  improved  weapon  systems  appear  to 
be  the  synergistic  consequence  of  many  (usually  on  the  order  of  100  to 
200)  separately  identifiable  Events,  each  contributing  a  negligible 
degree  of  improvement,  the  averaging  process  is  reasonable. 

When  the  consequences  are  manifested  In  a  number  of  weapon  systems, 
which  is  the  tendency  in  the  case  of  general  Events,  the  true  value  of 
that  Event  must  be  greater  than  that  of  one  contributing  only  to  one 


system.  Theoretically,  of  course,  if  every  weapon  system  anil  equipment 
in  the  Defense  arsenal  were  analyzed  and  the  contributing  Events  identi¬ 
fied,  it  would  be  possible  to  assign  to  each  Event  a  quantitative  measure 
of  value. 

During  the  Project  HINDSIGHT  study,  20  systems  were  sampled  with 
varying  degrees  of  thoroughness.  On  that  basis,  such  quantitative  meas¬ 
ures  cannot  be  made.  The  sample  size  Is  adequate,  however,  to  measure 
the  relative  efficacy  of  general  as  opposed  to  restricted  technological 
research.  Over  12  percent  of  the  identified  Events  in  general  techno¬ 
logical  research  had  an  impact  on  more  than  one  of  the  systems  studied. 
Where  this  situation  obtained,  it  was  generally  found  that  results  were 
utilized  In  three  or  more  systems.  With  respect  to  more  restricted 
technological  research,  the  use  of  results  In  multiple  systems  was  rec¬ 
ognized  in  8  percent  of  the  Events,  ai  1  then  infrequently  in  more  than 
two  systems. 

6.3-5  Planning  for  High  Payoff;  The  many  observations  on  charac¬ 
teristics  of  utilized  technological  research  arising  from  the  HINDSIGHT 
systems  study  could  be  used  to  provide  guidance  for  senior  research 
management.  Where  anticipated  results  of  the  research  are  considered 
broadly  applicable  and  the  estimated  cost  of  the  task  is  comparatively 
low,  full  authority  to  plan  and  implement  the  research  program  should  be 
vested  in  the  scientific  and  engineering  community  interested  in  the 
pertinent  technological  area.  Conversely,  where  the  apparent  applica¬ 
bility  is  more  restricted  and  the  task's  estimated  cost  is  relatively 
higr,  the  interests  of  the  system-oriented  engineering  community  should 
be  dominant. 

The  chief  possible  exception,  of  course,  Is  a  situation  in  which 
the  initial  cost  of  acquiring  a  facility  for  technological  research  of 
general  application  is  very  high.  Management  must  then  judge  whether 
the  application  cost  Is  properly  attributable  to  a  few  tasks,  or  whether 
it  should  properly  be  allocated  to  a  great  number  of  research  efforts 
planned  for  the  future. 

Again,  with  this  general  exception,  it  appears  that  there  is  greater 
assurance  of  a  high  payoff  from  the  more  expensive  research  tasks  If  the 
systems-engineering  community  has  some  respons ibi 1 1 ty  for  research  plan¬ 
ning,  It  was  observed  in  this  study  that  seme  20  to  30  percent  of  re¬ 
quirements  for  new  technological  knowledge — in  the  case  of  MINUTEMAN  II, 
up  to  75  percent — are  established  while  a  weapon  system  Is  being  devel¬ 
oped,  which  demonstrates  that,  at  present,  the  systems-engineering 
community  cannot  forecast  all  its  needs. 

An  apparent  solution  is  to  have  greater  recourse  to  the  current  R6D 
category  of  advanced  development.  Useful  prototype  weapon  systems 
should  be  designed,  developed  and  built  for  the  express  purpose  of 
giving  Focus  and  spur  to  the  growth  of  technological  knowledge.  This 
concept  is  not  new.  Whether  fortuitously  or  by  intention,  it  has  been 
used  to  great  advantage,  and  its  impact  Is  seen  through  "hindsight." 
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Thus,  in  retrospect  the  tremendous  value  of  the  NAVAHO  missile 
development  is  recognized.  There  were  a  number  of  reasons  that  the 
NAVAHO  never  became  operational,  paramount  among  which  was  the  appear¬ 
ance  of  the  Intermediate-rangi:  and  intercontinental  ballistic  missiles. 
Work  on  the  NAVAHO  continued  throughout  essentially  the  whole  RDT&E 
cycle,  however,  and  did  provide  a  quantitative  focus  for  all  the  tech¬ 
nologies  required  to  support  i  ts  development,.  It  is  also  noteworthy 
that,  at  the  start  of  their  development,  both  the  ballistic  missile  and 
the  NAVAHO  were  considered  high  technical  risks. 

Studies  of  the  technological  basis  for  modern  guided  miss i les  (such 
as  MINUTEMAN  and  POLARIS),  aircraft  and  nuclear  submarines  almost  in¬ 
variably  ■  fi nd  their  way  back  to  or  beyond  the  NAVAHO  program.  Inertial 
navigation  and  guidance  systems,  stellar,  navigation  systems,  flightborne 
digital  computers,  liquid  rocket  engines — all  have  been  traced  back  to 
work  identified  as  originally  done  for  NAVAHO. 

'  In  a  similar  vein — though  less  dramatic  and  on  a  lower  cost  scale— 
a  study  of  the  history  of  the  LANCE  missile  system  establishes  the  value 
of  the  Miss  Lies'- "A"  and  "B"  programs  in  the  1950s.  Again,  requirements 
to  advance  the  state  of  the  art  established  by  operational  specifica¬ 
tions  for  these  developmental  ml ssi les  spurred  the  growth  of  relevant 
technologies. 

A  more  specific  example  ts  the  contribution  of  the  Army's  DART 
antitank  missile,  which  was  never  produced.  To  be  economically  feasible, 
the  DART's  rol 1 -reference  unit  had  to  be  provided  for  a  fraction  of  the 
cost  of  available  gyroscopes.  As  a  result,  part  of  the  technological 
work  on  inertial  guidance  components  was  turned  away  from  the  quest  for 
ever-increasing  precision  and  focused  on  the  need  for  marked  cost  reduc¬ 
tion.  In  the  absence  of  such  motivation,  it  is  unlikely  that  the  quite 
reliable,  reasonably  precise,  very  Inexpensive  gyro  used  In  the  8ULLPUP 
would  have  been  readijy  available  for  it  and  for  other  missiles  as  well. 

These  examples  and  numerous  others  that  have  been  identified 
through  Project  HINDSIGHT  studies  indicate  the  wisdom  of  undertaking 
system- development  projects  in  a  conscious  attempt  to  focus  exploratory 
development  on  programs  of  research  in  technology.  Advanced  systems 
would  then  be  described  Tn  terms  of  operational  characteristics  and 
categorized  as  advanced  developments.  Maximum  freedom  should  be  granted 
the  project  director  to  seek  advanced  technical  solutions,  and  at  the 
outset  there  should  be  only  limited  definition  of  a  production  objective 
— preferably,  none. 

In  principle,  the  planning  inputs  required  for  a  high  payoff  of  the 
general  and  restricted  subclasses  of  technological  research  are  quite 
different.  It  is  possible  to  identify  real-world  problems  for  the 
former  by  examining  classes  of  weapon  systems — submarines,  aircraft, 
missiles,  armored  vehicles — and  recognizing  that  the  growth  of  specific 
areas  of  technology  is  essential  to  the  marked  Improvement  of  one  or 
more  of  those  classes. 


For  exnmpl l>,  it  is  obvious  that' .j  submarine's  depth  performance  is 
limited  by  the  slrength-to-weight  ratios  of  available  pressure-hull 
materials  ami  by  fabrication  techniques.  For  aircraft,  the  achievement 
of  greater  effective  operating  spued  depends  upon  the  availability  of 
thermally  less  sensitive  skin  materials,  as  well  as  better  understanding 
of  aerodynamics  technology.  To  gain  greater  precision  and  longer  rouge, 
artillery  weapons  require  more  efficient  propellants,  reduced  manufac¬ 
turing  tolerances  in  projectile  characteristics,  less  lube  erosion:,  and 
so  on. 

Because  such  problems  are  relatively  easy  tu  identify  and  research 
results  may  be  applied  to  many  systems,  the  inherent  probability  that 
the  knowledge  will  be  used  Is  high.  Further,  duplication  of  research 
can  be  safely  minimized  if  planning  responsibility  for  a  technological 
area  is  centralized  within  a  management  that  is  thoroughly  aware  of 
general  system  problems. 

When  the  technology  has  a  restricted  application,-  real  problems  are 
not  so  easily  identified.  The  risk  that  random  research  will  yield 
results  that  are  inadequate  to  solve  any  specific  problem  exceeds  the 
risk  of  duplicating  effort,  and  it  is  suspected  .that  the  work  is  fre¬ 
quently  of  less  interest  to  the  performers  of  general  scientific  and 
engineering  research.  In  order  to  gain  a  high  payoff  of  restricted 
technological  research,  planning  responsibility  must  be  decentralized 
and  assigned  to  the  specifically  interested  appllcations-orientcd  system 
designers. 
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7.  REQUISITE  LEVEL  OF  INVESTMENT  IN  RESEARCH 


I . 1  Strategy  and  Funding 

7.1.1  Research  Strategies:  Every  organization,  whether  it  be  a 
small  company ,  a  large  corporation,  a  nation,  or  a  national  agency  such 
as  the  Department  of  Defense,  has  a  research  strategy.  1 t  may  be  ex¬ 
plicit  and  well  documented,  or  it  may  be  determinable  only  through  in¬ 
duction  based  on  observation  of  behavioral  patterns.  Nevertheless,  the 
strategy  exists  and,  more  than  any  other  single  factor,  defines  the 
requisite  level  cf  investment  in  research  for  that, drgani zat ion . 

At  one  extreme,  research  strategy  can  call  for  assuming  a 
"parasitic"  posture.  In  that  case,  the  organization  allows  others  to 
sponsor  and  conduct  research;  then  it  adopts  (or  adapts)  certain  of  the 
findings  in  accordance  with  its  needs  and  purposes.  The  cost  of  this 
attitude  is  measured  in  terms  of  patent  fees  and  1 i censes— and ,  perhaps, 
in  loss  of  competitive  position.  Such  a  research  strategy  is  typical  of 
many  small  companies  and  also  of  newly  developing  nations.  As  reported 
by  A.  H.  Ruben stein, 2 8  it  typifies  most  of  the  home-entertainment  elec¬ 
tronics  industry  in  the  Chicago  area. 

Further  along  in  the  spectrum  Is  the  strategy  of  "reaction,"  in 
which  resources  are  allocated  for  research  only  to  solve  Immediate  prob¬ 
lems.  Great  scientific  discover'es  are  unlikely  either  to  be  made  or, 
if  encountered  serendi pi tous 1y ,  to  be  exploited.  Radical  technological 
innovations  are  neither  sought  nor  expected.  This  conservative  strategy 
seems  to  be  acceptable  to  most  consumer-products  industry  in  the  United 
States  as  well  as  in  some  of  the  smaller  European  nations.  Expenditures 
can  be  modest  and  research  efforts/  highly  selective.  Appropriations 
need  only  be  made  after  a  problem  has  beer)  identified.  There  may  be 
additional  expenses  for  licenses  or  patents,  but  the  probability  is  some 
what  less  than  in  the  case  of  the  fully  parasitic  posture. 

"  .  t 

The  reaction  strategy,  if  tied  to  a  well-planned,  long-range  engi¬ 
neering  development  program,  does  not  necessari ly  incur  any  great  risk 
of  loss  in  competitive  position,  national  or  corporate.  If  observed  too 
rigorously,  however  (as  discussed  later) ,  i t  mi tigates  against  the  Intro 
duction  oF  markedly  new  technologies  and  so  leads  to  rapid  increases  in 
the  cost  of  advanced  engineering  development. 

The  antithesis  of  the  parasitic  posture  is  an  aggressive,  forward- 
looking  strategy.  Clearly  the  most  costly  in  terms  of  immediate  cash 
layout,  this  strategy  prescribes  that  scientific  arid  technological 


28A.H.  Rubenstein  and  D.E.  Brewer,  Research  and  Development,  in  the 
Chicago  Area  Electronics  Industry  (Evanston,  Illinois:  Northwestern 
University,  \3i>l) . 
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oppor  I  un  i  t  i  «s  he  aggressively  sought  anti,  when  found,  exploited  a*,  con¬ 
sidered  necessary  or  desirable.  In  principle,  this  strategy  avoids  the 
risk  of  losing  competitive  position  and  minimizes  the  need  for  costly 
licensing  arrangements.  Its  great  disadvantage  is  that  many  findings 
will  never  serve  a  useful  purpose,  because  they  lead  either  to  urtdesired 
capabilities  or  duplicative  techniques,  of  which  oftiy  the  more. attractive 
alternative  will  be  useful.  In  practice,  the  forward-looking  strategy 
in  its  ultimate  Form  will  probably  never  be  adopted,  because  undoubtedly 
opportunities  for  research  will  always  exceed  ability  to  support  the 
required  programs. 

7.1.2  Strategy  for  the  Department  of  Defense;  The  fundamental 

concept  that  the  DoD  should  support  some  research  in  both  science  and 
technology  Is  not  currently  in  question.  It  is  generally  recognized  that 
a  potential  enemy  who  is  technologically  advanced  (or  advancing)  repre¬ 
sents  an  increasingly  severe  threat,  and  that  .consequently  this  nation's 
military  capability  must  be  continuously  upgraded  merely  to  maintain 
parity,  •  •  •  : 

The  rata  of  the  DoD's  Investment  In  research,  however,  has  been 
questioned.  Competent  authority  suggests  that  "The  high  level  of  support 
of  basic  work  is  producing  scientific  and  technical  Information  at  such 
a  high  rate  that  it  cannot  be  effectively  digested,  interpreted,  dissem¬ 
inated,  or  put  to  useful  purpose."  Translated  into  terms  of  the  three 
strategies  discussed  here,  It  is  agreed  that  the  DoD  must  adopt  a 
strategy  of  at  least  reaction,  but  it  is  felt  that  moves  toward  an  ag¬ 
gressive,  forward-looking  strategy  will  require  a  more  pragmatic  ratio¬ 
nale  than  has  previously  been  afforded.  This  Is  Inferred  from  the  fact 
that  critics  are  demanding  greater  proof  of  value  In  relation  to  the 
current  level  of  expenditures. 

In  reality,  the  problem  faced  by  Defense  RED  management  is  twofold: 
First,  define  a  research  strategy  that  is  consistent  with  the  strategy 
employed  in  relation  to  all  RED;  and,  second,  demonstrate  that  the  re¬ 
search  strategy  defined  is  a  sound  one.  The  requisite  level  of  Invest¬ 
ment  in  Defense  research,  then,  will  be  the  minimum  needed  to  support 
that  strategy. 

7.1.3  Relevance  of  HINDSIGHT  Findings  to  DoD  Research  Strategy 

and  Funding:  Project  HINDSIGHT  was  neither  intended  to  define  a  research 
strategy  for  the  Department  of  Defense  nor  designed,  to  defend  whatever 
strategy  has  been  used.  Clearly,  however,  many  of  this  study's  findings 
are  relevant  to  those  matters.  Further,  the  HINDSIGHT  data  permit  a 
limited  evaluation  of  balance  among  the  several  areas  of  technology  in 
the  DoD's  research  program. 

The  purpose  of  this  discussion  is  to  highlight  those  findings  that 
bear  on  matters  of  research  strategy  and  funding,  interpret  ng  the  data 
where  possible,  or,  where  the  data  alone  are  Inadequate  to  support  a 
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colic  lu?>  i  on ,  :.|H-t:u  lot  i  iui  on  l  lit?  *  r  probable  •,  iyni  1  i  cancc.  The  logic  is  a'. 

To  I  I ows : 

(1)  Consider  ilie  return  on  i  lives  t  filer  it  resulting  from  I  he 
strategy  Unit  Inis  been  espoused  by  the  Department  oi  Defense  since 

(2)  Compare  the  DoD' s  research  strategy  with  an  averaged 
strategy  of  the  intensively  technological  U.S.  industries;  and 

(3)  Examine  the  likely  consequences  of  major  shifts  in  DoD 
research  strategy  or  funding. 

7.2  Measuring  Return  on  Investment 

During  the  period  19^5"I963>  the  Department  of  Defense  spent  approx¬ 
imately  $10  billion  on  scientific  and  technical  investigations.  (This 
does  net  include  a  considerably  larger  sum  that  was  invested  in  the  en¬ 
gineering  development  of  weapon  systems  and  other  mi  1 i tary  equipment.) 

The  strategy  adopted  for  the  support  of  this  research  program  can  be 
inferred  from  several  observations  in  Project  HINDSIGHT. 

The  most  significant  relevant  finding  of  this  study  is  the  determi¬ 
nation  that  67  percent  of  the  RXD  Events  affecting  the  systems  examined 
occurred  prior  to  the  designing  of  the  equipment  through  which  the  Event 
was  identified.  That  is,  at  most,  one-third  of  the  work  could  have  been 
undertaken  in  response  to  specific  problems  uncovered  while  the  system 
was  being  designed  or  developed. 

This  plainly  suggests  that  a  considerable  portion  of  the  research 
money  was  in  fact  invested  under  a, forward-looking  strategy.  Supporting 
evidence  is  found  in  the  definition  of  the  RED  budget's  six  elements. 
Although  this  budget  structure  was  not  formally  introduced  until  toward 
the  end  of  the  period  studied,  it  served  more  to  dignify  existing  prac¬ 
tice  than  to  impose,  a  different  research  strategy. 

Moreover,  according  to  the  historical  funding  pattern,  from  20  to 
25  percent  of  the  RED  budget  has  been  allowed  for  scientific  and  techni¬ 
cal  investigations.  Any  measure  of  the  return  to  the  nation  from  the 
Department  of  Defense's  1945-19^3  investment  of  the  $10  billion  In  scien¬ 
tific  investigations  inherently  includes  the  measure  of  a  forward-looking 
research  strategy. 

A  crude  but  useful  way  to  measure  return  on  investment  is  by  estab¬ 
lishing  the  cost  differential  between  a  modern  weapon  system  and  an 
operationally  equivalent  array  of  Its  predecessors.  This  differential 
is  then  compared  with  the  cost  of  the  science  and  technology  that  enabled 
the  advanced  system.  The  posit  is  that  the  point  of  marginal  return  has 
been  reached  when  the  cost  of  new  research  exceeds  the  savings  gained  by 
replacing  the  earlier  systems. 
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Ibiee  **t  In*  i  *.  i  *|ii  i  I  i  i  ,nt  I  I  imi  I  ,it  ii,ii*.  nl  lli  i  s  '.ip|*i«i.i<  li  I *i  i**-.i*.ui  i n*i  i*i.n*, 

**il  i  iivt1*.  t  lilt'll!  uni*.!  in*  .*vi*t  i  rink* . 

iii  ll»  lew  ext **|* I  iiin*. ,  l  In*  |»i*i  I  hi iimik  i*  (il  ,i  mr.ili-in 
iv  t  ipun  *,y.U*r,i  exceeds  eve  I  y  essen  l  iii  I  I  tine  I  inn  ul  its  pn*tlen**.*,iji'.  II, u. 
it  is  possible  to  esl.ih  I  i  sli  lilt*  nititibei  ul  tin*  <»  t-«K*  i  •  >  I  ype  lli.il  uii  In* 
rep laced  by  .i  s ingle  ymiWMir,  J’t  ejjMent  ly ,  however ,  llii*  slice  essoi  sys¬ 
tem  provides  a  completely  new  capability,  um*  that  n*i  minibet  tii  the  u  I  *h  *  i 
systems  could  match.  l  or  example,  i  I .  is  meaningless  to"  totitpnrt*  any  num* 
bo r  of  the  90mm  or  l?0tnm  medium  or  heavy  an!  i  ail  cruf  r  naileries  of  •'*••. 

1 9  fi1**  with  tlio  iixi  re  recent  Nl  KE-HERCULLS  missile  tit;  I  oust: .  The  guns  were 
so  limited  with  respect  lo  altitude  that  an  infinite  number  of  bat  it:  rite, 
could  not  afford  equivalency,  for  purposes  of  the  re  turii-on- investment 
analyses,  the  systems  are  compared  only  on  the  basis  of  capabilities  that 
both  possess;  excess  capabi ) i ty  on  the  part  of  the  successor  is  treated 
as  a  bonus .  .  * 

sx’S'd,  because  it  is  essentially  impossible  to  I  deni  ify  anti 
isolate  the  .  upported  research  in  science  or  technology  that  contributed 
solely  and  totally  to  any  given  weapon  system,  a  cost-value  analysis  of 
research  in  relation  to  a  single  system  cannot  be  performed.  It  is 
possible,  though,  to  estimate  the  total  DoD  investment  in  research  during 
the  time  the  knowledge  was  gained  that  enabled  the  s/stem's  development 
and,  men,  lo  consider  any  cost  advantage  of  the  new  weapon  system  in 
terms  of  a  percentage  of  the  total  Investment. 

The  Task  I  studies  of  Project  HINDSIGHT  have  demonstrated  that  the 
new  knowledge  utilized  in  modern  weapon  systems  was  gained  predominantly 
during  the  years  19^5  through  1963.  DoD  expend i tu res  for  research  in 
science  and  technology  in  that  period  have  been  estimated  as  between 
$7.5  and  $10  billion;  the  spread  is  caused  by^changes  In  accounting  pro¬ 
cedures  that  are  believed  to  have  obscured  some  of  the  expenditures. 
Hereafter,  in  comparing  the  savings  accruing  from  each  new  type  of  sys¬ 
tem,  the  higher  figure  will  be  used. 

Third,  a  difficulty  arises  as  a  result  of  various  design 
comp rom i ses  that  have  been  made  in  a  succession  of  weapon  systems,  This 
forces  a  certain  amount  of  normalization  of  system  designs  before  ,j 
comparison  can  be  made.  The  fact  that  the  requirement  for  a  considerable 
amount  of  new  technology  continues  throughout  the  engineering  develop¬ 
ment  of  an  advanced  weapon  system  indicates  that  the  system  engineer  has 
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I'l'i'i.  i  Ilf  l  1101  1  |’f  I  I  III  IIKIIll  f  llflllllllS  I  I  .III".  I'lir  ilKlf.1,1  .  III.,  |  ,7i  'll* 
fii.il'lftl  l«s*  n»‘v;  I  f  f  lint .  I  m|  i  f  ,i  I  i  n  1 1 .11:1.1 1  :  on  ,11 1  niiiu  i  .1 1  <  d  li.'lwie;!  I'  .Mi  .mil 

1%'.’  ■  liinilf.l,  huwevei  ,  liy  I  lif  tlf  s  I  t|iif  1  '  (iliilily  i  <>  1  :  ot  1 1  t  In  ms. 

I  e.  hu.il  egy  in  t  lif  iiltlfr  b.i-.  iv.  a i  rl  1  «niif  .mil  engine.  Ilia  l.  IM's  pi'il-.i- 
m.iiKf  shows  ilia!  c  onip.ir.il  i  vf  I  y  much  greater  gains  are  possible  th'pugh 
a  totally  now  tlo vo lo|.nifnl  program  tli.il  can  exploit  ali  of  the  newly 
availahlo  1 00.I1110  logy  .  Comparative  po  rformanco  capabilities  of  Huso 
aircraft  are  shown  in  f  igures  1/  anti  18. 

I"  1999.  1  ho  Air  Force  introduced  lilts  C  - 1 30  transport  aircraft  inio 
sorvico;  in  1964,  I  ho.  C-I4I  aircraft  was  added  io  tin-.  operating  inven¬ 
tory  Project  HINDSIGHT  toam.s  investigated  the  difference  in  the  tech¬ 
nologies  ■inder  lying  the  development  oT  these  two  aircraft  arid  eslabl  i  shed 
that  l  ho  porfor.Hi.jnce  character' s ti cs  of  the  C - 1  h I  could  not  have  been 
achieved  with  the  technology  available  in  1959-  Through  retrofit,  the 
-  model  (on  upgraded  C - 1 30)  made  use  of  technological  knowledge  acquired 
during  (he  9-yoar  life  of  the  basic  aircraft  design.  Modification  by 
retrofit  imposes  significant  limitations  on  upgrading,  such  as  the  ex¬ 
tent  to  which  a  fuselage  can  be  stretched  or  engine  power  added  without 
completely  redesigning  the  aircraft.  Despite  those  limitations,  the 
productivity  of  the  C-130  was  increased  about  40  percent,  and  the  range, 
about  60  percent. 

Where  an  entirely  new  design  was.  undertaken ,  as  for  the  C-141,  the 
f u I  I  potent i a  I  of  technology  could  bo  exploited.  As  a  consequence,  a 
payload  differential  in  excess  of  100  percent  and  an  effective  range  * 
increase  of  the  same  order  of  magnitude  were  .n chi cved.  In  addition,  the 
C-I4l's  i.£>x  combat  speed  advantage  means  that  it  takes  fewer  operating 
hours  to  deliver  a  payload  over  a  given  distance,  and  this,  in  turn, 
reduces'  overa 1 1  operating  costs.  A  very  conservative  estimate  of  the. 
return  on  investment  in  scientific  and  technological  research  i ncorpo- 
r.iti’d  in  the  C  - 1  h  1  aircraft  may  lie  based  on  the  relative  operating  costs 
per  ion-mile  capability  of  the  C-141  and  the  upgraded  C-130  over  a 
50, 000-hour  flight  life. 

Con  .  i  <le  ring  lirccl.  operating  cost,  system  support,  flignl-crew  pay 
uni  "iiiw.iin'.i-  ,  .in!  depreciation,  the  lolai  cost  per  ton  -mi  le  repohi  I  i  tv 
•I  ■  .  i".  1  i:n.i  I  ed  at  '0.,,l7.  A  similarly  adjudged  r.rist  for  the 
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I*'  *.  !.llit\  llu*  i  ii:ii|i.i  i  Tii  in  nl  lilt-  1  *  I  (ll  .hhI  I.  Mil  ,ii(.|.ii|,  iiht*  |j,iin! 
'•in**  I  In*  I'l.iili*.  II  i  *i  _  i  1  i'ii  i  ly  umli*  i  *.t  in  til  lli.il  I  In*  mi  .'.  i  Hi,  *i)i  j , -Hi  til  (■■"*.  i  <  j  1 1 
i.  liil!  .ii  l  hi  i  *.  I  i  i  ill  i  In*  Ivrti  .lint, ill  ilillft.  Iiivt-ii  tin*  l  ii  Inn,  Ii  ,i|  ii.,,  I 
v  .ip.ibi  lily  In  Ini  i  lil  linlli  uf  I  In*  nil  ll. ill,  llu*  Ai  i  linn*  j  •,  in  <i  pos  j  t  iiin 

Iii  Iniiltl  *,iiiiii'  u!  T.it'li  1  ypi*  ti!  .I  i  1 i  - 1*  .it  I  ,  wht*li*  *,in.lr  ,j  i.l'niii*  bi*lli*i 

*n*i  v.i*.  llu*  tut. i  I  miss  inn  i  r-.pons  il>  i  I  i  ly  hy  opt  i  in  i  zi mj  (In;  iIts  iqn  loi  Hit* 

inissiiin.  In  .1  In*  .ilisi'lin*  ol  techno  loqy  pe  i  mi  I  I  i  tit)  the  0141,  hovayci  , 

there  would  In*  no  option,  .mil  llu*  C- I  it) 1  s  cli.irut  I  e  r  i  s  i  i  c*.  would  esl.ibl  i  *.h 
Hit*  limits  on  c.ip.th  i  I  i  i  y ,  I  l  cannot  then  In*  coin.-  hided  that  additional 
savings  woo  lil  bo  ro.i  I  i  /oil  by  replacing  .ill  C-I30s  with  C  —  1  *.. .  II  t-.jn 

only  bo  c  oh  c  I  ml  oil  l  hn  l  ,  in  t  In?  absence  ol'  tin*  C-I4I,  llu;  total  mission 
woulil  bo  more  expensive  because  the  C- 1 3U  (or  ils  techno  logical  equiva¬ 
lent)  would  li.ive  to  perform  both  the  mission  lot*  which  iL  is  optimized 
and  that  lot  which  the 0-11)1  is  designed. 

i'-i  .1/,*  (  .I.V.4**VVi'— /fi  n'a./io'.:;  Another  weapon  system  studied 

under  Project  HINDSIGHI  was  the  AN/SPS-48  radar.  This  surveillance  and 
target -acqui si tion  radar,  now  being  used  in  the  fleet,  is  generally  an 
operational  successor  to  the  SP  surveillance  radar  of  World  War  II 
There  have  been  other  intervening  radars,  but  in  terms  of  technology  all 
were  subsequent  to  the  SP.  It  may  be  assumed,  however,  that  they  used 
part  of  the  r.ew  technology  purchased  wi  th  that  same  SIO  billion,  so  they 
need  not  be  considered  in  this  analysis. 


At  least* 40  SPs  would  be  required  to  afford  the  »ame  degree  of 
effectiveness  in  radar  surveillance  as  that  obtainable  from  a  single 
AN/SPS-48.  Because  of  significant  differences  in  the  two  radars'  maxi¬ 
mum  range  capabilities,  39  of  the  AO  SPs  would  have  to  be  carried  on 
separate  ships,  optimally  distributed  over  a  large  area,  to  normalize 
space  power  density  and  data  rates  over  the  volumetric  coverage  of  the 
AN/SPS-48.  Let  us  assume  that  this  could  be  done  and  that  adequate 
communications  could  be  arranged  to  maintain  the  distribution  and  enable 
the  effective  transfer  of  information. 

The  acquisition  cost  of  the  40  SP  radars  would  be  from  $6.5  million 
to  $10  million  more  than  the  single  AN/SPS-48,  depending  upon  how  much 
the  unit  cost  might  be  reduced  in  view  of  the  greater  SP  production. 

Mora  important,  though,  39'  addi lional  ships  would  be  required,  each  with 
a  total  operating  cr ew  of  some  200  and  costing  in  excess  of  $15  mil licrn. 
Assuming  costs  of  $200,000  per  SP  and  $1,5  million  per  AN/SPS-48,  the 
direct  cap i la  1 -expendi ture  cost  o;  accomplishing,  with  1945  technology 
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The  t.i*l o  intent  in  presenting  this  rdti.tr  example  was  to  ••nvi!> I *-  vImi  i! 

i.'ing  the  magnitude  of  the  payoff  of  resenreli  in  e  iem;e  .on!  tic! h- 

The  earlier  example  .if  the  ai  rcral  l ,  ,uu  the  other  hand,  i-.  a  i:ioi>-  >n- 
crete,  real-world  case. 

f 1  The  return  on  investment  in  •  ivmmi  ch 

can  be  similarly  demonstrated  for  each  of  the  systems  studied.  To  •!>>  a. 
(particularly  For  expendable  items  such  as  missiles,  mines,  lorpudw.  >>\ 
other  munitions)  would  involve  the  use  of  highly  classified  i  nfcrmot  ir.n  . 
on  expenditure-rate  planning.  In  some  cases  (e.q.,  nuclear  warheads), 
even  relative-effectiveness  ratios  are  classified.  An  indicuL.on  of 
real i red  returns  from  new  science  and  technology  in  some  otho>  systems, 
however,  is  suggested  by  the  ratios  shown  in  Table  XXVI  1 1 . 


Table  XXVIII.  TYPICAL  INCREASES  IN  RATIOS  OF  OPERATIONAL  - 
EFFECTIVENESS  IMPROVEMENT  ENABLED  BY 
TECHNOLOGY 


Estimated  factor  of 

Weapon  System 

operational  improvement 

Current. 

Predecessor 

in  a  common  role 

M-102  105mm  Howitzer 

M2A!  1  Oun»n  Howitzer 

1.4 

Mk  46  Mod  0  Torpedo 

Mk  44  Torpedo 

12..  n 

Mk  56  Mine 

Mk  10  Mine 
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•  ri*-i  ,i  smaller  itivo*. tinon I  .  Out-  veiy  im-.ininqfu  I  lest  of  tin.-  .idequ.icy  of 
-'i.iii.kii'iiil'ii  t  Is  offered  hy  t  ho  HINDSIGHT  tl.il.i. 

Undoubtedly  the  two  most  difficult  Dot  i  slims  that  must  In;  mo  Do  hy 
■’M.i.'nio rs  of  the  OoD  research  program  involve  l he  total  numbef  of  dol  lars 
to  bo  made  dvai  lable  for  research  each  year  and  the  relative  apportion¬ 
ment  of  i  unds  among  the  competing  sciences  and  technologies ,  This  study 
doe-  not  extend  to  a  direct  test  of  the  wisdom  reflected  in  total  dollar 
level-,  It  is  possible,  however,  to  estimate  the  quality  of  judgment 
exercised  in  apportionments.  One  iniglit  l lien  speculate  that,  because  the 
same  people  word  involved  in  both  sets  of  judgments,  the  wisdom  displayed 
wet  about  as  good  in  one  as  it  was  in  the  other.  Also,  an  indirect  Lest 
of  the  reasonability  of  the  total  dol  lar  level  is  presented  in  section 
7.4. 

in  Table  XXIX,  many  of  the  sciences  and  technologies  shown  in  Table 
VIII  are  listed  in  relative  order  of  funding  during  FY  1966.  Some  items 
wore  omitted  because  the  systems  in  which  those  technologies  would  be 
important  weie  not  represented  by  the  types  studied  in  Project  HINDSIGHT. 

Table  XXIX.  RELATIVE  FUNDING  OF  SCIENCES  AND  TECHNOLOGIES,  FY  1966 


1. 

Mi ssiles 

8. 

Physics 

2. 

NaviyiitiO"  and 

9. 

Mechanical  and  civil 

communications 

engineering 

J  . 

'idtiiin-u 

10. 

Materials 

A 

.  >*  •  I  r-.-ri  i !  ■? 

11 . 

Mathematics 

■  (•!.(•*.  1  i-'ts  and  fuels 

12. 

Chemistry 

r. 

urine :  i 

13. 

Atmospherics 

/. 

ii. fin'!  i*iO  i-ij-i;i>i-ient 

Id. 

Energy  conversion 
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Satellite.*,  .wit!  only  the  oihtting  portion  <il  tin*  system  -./.(s  e/..ii»i  im-,1. 
Nest,  I’l.i  jur  advances  in  llntsc  i«n  Imolniiic  ,il  ,iii*,i*,  pos lil.ilt-tl  most  .1  it.- 
tii'M'  flame  t  I  "tVi  - 1 1)6  5 )  wilt  which  I’loject  HINDS  Ihlll  is  coin  (*t  tied .  Shu-,. 
alUKUigh  tor  ili  I  ft*  ring  i  i*ti*tiMit, .  tlti‘  HINDSIGHT  data  do 'not  «ill<n  I  .in 
o-'i'Oc  i  ,i I  K*  ijoml  t i*s t  in  i  In*  case  ol  *» I «,*c i  ronies ,  iivii«*t  ials  ,  n.wig.il  ii-i 
oi  voenuini  c.il  ions , 

It  i*.  possible  th.it  this  part  iculat-  coelficient  of  rank  cot  1 1*  I  at.  ion 
■iiitti-.tii'os  ,i  c  i  t  cui  I  ous  ly  self-serving  phenomenon ;  that  is,  .is  a  cunsi- 
giuiiWi*  eh'  heavy  f uncling,  there  Imvo  boon  more  accomplishments  in  certain 
.in*. is  of  sc  i  once  otul  technology.  Undoubt  ml  I  y  .there  must  be  sonic*  corre¬ 
lation  tie  tween  level  of  funding  and  probability  of  successful  achieve* 
rient  :  to  some  degree,  there  is  a  resultant  bins  in  the  HINDSIGHT  data, 
in  general.,  hawovei  ,  the  approach  used  in  this  study — the  retrospective, 
tracking  of  the  How  of  science  and  technology,  starting  with  utilized 
rather  than  laboratory-advertised  products  of  research— serves  to  mini¬ 
mize  the  consequences  of  rite  bias. 

To  tite  extent  that  managers  oF  DoD  researclt  dictated  the  nature  of 
tlie  weapon  systems  to  be  developed,  they  had  opportunity  to  encourage 
the  use  of  their  programs'  results  in  those  systems.  Wherever  the 
weapon  system  was  developed  by  an  independent  agency,  such  as  an  indus¬ 
trial  contractor,  the  opportunity  would  be  minimum;  and  that  was  the 
situation  with  respect  to  almost  all  the  weapon  systems  studied  in 
Project  HINUSIGHT.  Thus,  the  rank  correlation  does  measure  the  quality 
of  managerial  judgment  in  at  least  the  matter  of  resource  allocation. 

As  previously  noted,  a  .coefficient  of  rank  correlation  of  0./  would 
he  "high."  Ignoring  the  possibility  ol  logical  adjustment  to  0.D3  .-,*, 

•  Inscribed  before,  a  correlation  of  0.33  is  enough  to  demonstrate  tint 
'  management  lias  done  an  excellent  job  of  allocating  its  resources  cmnt.g 
competing  scientific  disciplines  am)  areas  of  technology . 

'Correlation  significance  test  :  i  * 
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In  q  i*  iiu  ro  I  .  comp  nil  i  es  (.hot  an:  deeply  involved  in  technological 
act  ivi  ti.v;  mu**.  I  main  la  in  aggressive  research  and  development  programs; 
tiie  marketplace  holds  a  continuing  challenge.  The  Department  ol  Defense 
i  *.  in  a  truly  analogous  situation  only  when  international  peace  is  in 
sur :ous  danger.  When  there  is  no  immediate  threat  to  national  security, 
it  may  be  possible  to  curtail  or  postpone  the  development  of  new  weapon 
systems  until,  as  technology  grows,  opportunities  for  even  belter  weapons 
arise.  If  the  DoD  research  program  i s.  maintai ned  at  a  healthy  level 
during  those  relatively  peaceful  times,  the  balance  between  research  and 
development  should  shift  away  from  that  adopLed  by  industry.  In  brief. 
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During  the  past  few  decades  the  national  security  has  continuously 
l.  •!•:*»■  in  jeopardy.  The  al  location  of  DoD  resources  between  research  and 
'I'lyi’h-pmenl  can  In*  meaningfully  coiiipa re<l  with  that  of  this  industrial 
•ec  tor. 
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Utili/imt  Doll  strategy  os  .1  Intse  fur  tolcul.il  inn  ,  Taihl  «•  XXX  display, 
lot  fiscal  years  I l_)62  through  1‘J6/: 


the  reported  DoD  opport ionment  for  tot a  I  Rf.U  (column  ?); 


* 

H 
■  * 
V\’ 

* 

'i 


*'4k 


■  the  opproxim  •  tend)  litres  or  cil  locations  fur  research 
jm.1  exploratory  devolopmc.-  jlumns  3  and  G)  ; 

.  the  levels  that  would  have  been  assigned  if  the  average 
industrial  funding  strategy  had  been  invoked  (columns  4  and  7);  and 

the  percentage  differences  (columns  5  and  8). 

Apparently  the  Department  of  Defense  has  adopted  a  more  conservative; 
posture  than  industry  with  respect  to  research  and,  until  recently,  a 
more  aggressive  posture  concerning  exploratory  development. 

Difficulties  if!  reconciling  the  two  sets  of  definitions  may  be 
responsible  for  greater  apparent  differences  in  this  table  than  actually 
exist— that  is,  the  DoD’s  definition  of  research  may  be  more  rigorous 
than  industry's.  The  consequence  of  that  difference  would  be  a  mis¬ 
leadingly  high  industrial  figure  for  research  strategy  (column  k)  and  a 
correspondingly  low  figure  for  exploratory  development  (column  7). 

of  ikxUi  on  Science  Hcc.ouvccn  (Washington,  D.C.:  National 
Science  Foundation,  NSF  66-33 ,  December  I966)  ,  p.  9. 

* 1 Applied  r.-.n'avch,  a»!  /tav/..  J 

(Washington,  D.C.:  Notional  Science  Foundation,  NSF  66-28,  June 
I966).  f-'.j'wl  h'uwJn  for  Kencaiuk,  !krt!i;lopr»,’tit  ivi ;  P! »:, 

F7  until,  UUP1  (Washington,  D.C.:  National  Science 

Foundation,  NSF  66-25,  I966)  ,  1_5. 
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rough  clii-i-k.  Compi  essed  I  i ini'  schedules  lor  wetipon -system:,  drve  I  opiin  ii  l , 
higher  development  Cos  is  resti  1 1  ing  front  system  sped  fitiit  ion'  lot  cx- 
t  .erne  degrees  ul'  m.i  ir.l.ii  ngbi  I  i  ly  .mil  re  I  i.ihi  I  i  I  y ,  and  Ihe  like,  combine 
to  ere. ile  n  s  i  I  nation  it:  which  Lite  DoD's  .ipport  ionnicnl  nould.be  shilled 
soinewli.it  ilo-uM*  to  development  man  is  necessary  'll'  Industry.,.  This 
shill  should  he  p. wily  offset  by  the  lac t  that  il  is  more  important  to 
ensure  the  survival  of  the  nation  than  of  a  single  company;  and,  t  lie  re¬ 
fill  e,  the  Doll  shmi Id  adopt  ail  even  more  forward-looking  research  strate¬ 
gy  than  the  most  technological  ly  intensive*  industry  .  Novel  ilioless ,  the 
analysis  does  demons  irate*  that  the  level  of  DoD  expend!  tines  for  research 
in  sc  ience  and  technology  has  not  been  significantly  ouL  of  line  with 
wtiat  U.S.  industrial  strategy  would  prescribe  in  an  analogous  cfnviron- 

PlL'lll  . 

/ .  I>  KConiiRiies  of  a  Forward-Looking  Research  Strategy 

in  the  preceding  section,  it  was  noted  that  the  Department  ol 
Defense  evidences  a  forward-looking  research  strategy  and  further  (with- 
)"l  den, oris  I  >M  t  i  on)  that  such  a  strategy  can  be  the  most  effective  and 
••!'*' Irion  I  of  l  lie  several  possible  alternatives  described  in  sect  im  /.I. 
findings  el  i  he  HINDSIGHT  study  suggest  that,  if  a  steady  increase  in 
w*. ipirm  systems'  per loriiMiicc  or  cost -of  feet ivenoss  is  sought  ,  the  only 

w. iy  to  avoid  a  rapid  escalation  ol  research  cost  is  to  adopt  an  agies- 
,iv",  forward-  li.ok  i  rig  research  strategy  calling  for  a  cons  iilerahle 
-iin.i'ie.  >.l  highly  speculative  research. 
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hi'  t'Ni'i'i  t  i'il  In  ii-. nil  I  1 1  >in  ,|  '.li.iti'iiy  lit  |  i'.h  I  inn.  A‘.  <i  i  ihii|h  ilii'ii  I  1  •, 
.li'liii.'.K  i  i",  .iti-  i  ili'iit  i  I  i  i-.l ,  .1  l  fi.'.ii  i  Ii  |j  1 1  ii|  i .  mi  i.  .in  In-  iiiiiIi- i  I  .il  i'ii  I  '< 
i  nip  t  iiy  i*  till'  i  ni'i|'iiiii'ii  I  without  m*i  i'V,.n  i  I  y  si*i-l>iii(|  i.idic.il  m-w  I  i  t.  hni  ipn", 
Im  pi' i  I  in  mi  mi  i  l  *.  I  uiiL  (  i  tin .  Ai|,iin,  l  ii  i  •.  is  ,j  gi'iit'i  a  I  i /.it  i  on ,  hut  it  is 
I  .ii  i:\iii'  nlli'ii  I  i  tu'  ul  llif  It)  systems.  Ih.in  not. 

in  Tiymv  I1),  tin-  i".l  i  iii.il  ml  iniprovi'iiii'nl  I  .it,  tor  lor  tin-  prccluct".  cur  - 
■iul'ci'ssoi'  pairs  is  p lot  t t'll  .iy.) i ns t  a  measure  of  t lie*  predecessor 's  t cc.li- 
nic.il  sophist  i  cat  i»n  as  a  lime  lion  <>l  the  number  of  RXD  Events  requi  r  i  -  *  I 
to  attain  the  more  .niv.ineoil  sticcessoi  system.  "hnproveinen1  Inc.lm"  i' 
del i ned  as  the  lalio  ul  the  successor's  cos t-uf feet iveness  to  that  of 
the  predecessor.  (More  rigorously  construed,  it  is  effectiveness/tost: 
el  I ect i veness/cost . )  The  sophistication  of  the  predecessor  is  assessed 
in  terms  of  cost  per  pound  of  the  production  mode).  The  particular 
function  of  the  number  of  RXD  Events  is  the  logarithm  to  the  base  10  of 
the  number . 

Intuitively,  tlie  mathematical  formulation  expressed  in  the  plot 
appears  reasonable.  Experience  tells  us  that  generally,  as  an  equipment 
becomes  more  complex  or  sophisticated,  a  greater  amount  of  effort  is 
required  for  each  successive  increment  of  improvement.  Analytically, 
that  experience  may  be  rephrased:  The  improvement  factor  is  proportion¬ 
al  to  some  nonlinear  function  of  the  added  complexity  or  sophistication 
of  the  new  system  and  to  the  level  of  complexity  or  sophistication  of 
i ts  predecessor. 

For  the  first-order  approximations  permi tted  by  the  available  data, 
it  appeared  reasonable  to  assume  a. logari thml c  relationship  between 
number  of  RXD  Events  and  improvement  factor.  (The  reasonability  of  this 
assumption  is  supported  by  the  fact  that  the  data  fit  a  straight  line 
over  a  range  of  departure  that  exceeds  a  factor  of  10  on  the  vertical 
axis  and  a  factor  of  30  on  the  horizontal.) 

Figure  19  provides  a  means  of  speculatively  demonstrating  the  level 
of  research  costs  that  might  be  expected  if  the  Department  of  Defense 
were  to  employ  solely  the  strategy  of  reaction  in  its  research  activi¬ 
ties.  Assume,  for  example,  that  an  improvement  factor  of  about  60  per- 
.cent  is  desired  in  a  solid-propellant,  incrtially  guided  ICBM.  From 
Fig1  re  19,  the  factor,  "complexity  X  logjg  No.  RXD  Events,"  is  seen  to 
be  0  07.  inowing  that  an  ICBM  of  the  current  generation  delivers  for 
roun.-lv  $40  a  pound,  a  requirement  for  close  to  1,000  scientific  or 
tc'Cii.io logical  advances  is  evidenced.  Now  let  us  assume  (very  conserva¬ 
tively)  that,  on  the  average,  we  can  expect  full  success  in  25  percent 
of  our  research  program.  That  is,  of  every  four  ideas  tested,  at  least 
one  will  hi  found  worth  pursuing. 
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II  Mu*  IfSf.lH  lifts  4«'if  .f.ki'd  ill  |itlivjl|f  tl  till'. Ills  till  ill^it  Ii  .•  i  In,  .1 
"ilit.H\  l  ,l|l,ll>  i  1  i  I  y  l.itllfl  til, in  illi|l|UUf  ,1  1 1  i  v  it  I  I  ypf  i.l  .f.l  I'm,  t  lit- 
fiisiii  1U|  s  i  l ii.t |  i on  HI  M|h  l  In’  1  mii|i  |i‘ t  f  | y  ili  I  1**1  flit  .  In  ili'cmns  1 1 .1 1 1 1 
•ii, |hl  oi  i  in  ,  li.f.Otl  mi  experience,  lei  us  lnuk  .il  ,1  <1  j  1  leii-ui  i/.iiup  |. 
Uperal  ioiuil  ly ,  the  SUn'Iight  Scope,  .1  nighl  -  vision  ilevii**  *,tu'M*-'l  in 
Project  HINDS  Hilir,  if  |>  I  aces  the  /x*>0  |iiitm.ul,irs .  Clliv*utf.ly ,  it  is  '.n't 
unli1  ■*!>  (ha  I  any  amount  ol  improvement  in  I  In*  opt  Ii.s  «*«  iwi  lnu.ii.il 
st  rue  tuiv  of  binoculars  con  I  tl  match  the  new  tlev  i  ».e  ‘  *.  light  •wip  I  i  I  ■<  at  is:- 
capabili  ty.  Nonetheless,  assume  that,  Instead  ol  in)  indue inq  cir-pletel/ 
new  techniques  based  on  resul  IS  of  some  speculative  reseat-:  Ii,  it  was 
desired  to  improve  the  binoculars. 

Working  through  Figure  l‘.)  and  using  the  actual  improvement  l;n  im 
(which  is  classified)  oT  the  Starlight  Scope  over  the  binoculars,  sue 
finds  that,  again,  about  1,000  RXD  Events  would  be  needed,!  as  compared 
to  the  less  than  30  Events  that  were  aeltally  identified  by  the  study 
team. 

Another  example  olfering  comparable  numbers  is  the  Navigation 
Satellite  with  a  "much  improved"  loran  radio  navigation  system. 

Admittedly,  both  examples  are  specious;  but  they  do  make  the  point 
that  marked  operational  improvements  in  sophisticated  equipment  are  far 
more  likely  to  be  achieved  at  moderate  cost  when  completely  new  tech¬ 
niques  are  Introduced  than  when  the  overall  improvement  is  sought 
through  the  deliberate  refinement  of  each  technique  used  in  the  prede¬ 
cessor  equipment. 

These  simple  cases  should  demonstrate  beyond  any  reasonable  doubt 
that  an  aggressive,  forward-looking  research  strategy  with  considerable 
room  for  speculative  research  is  essential  if  weapon  systems  are  to  be 
improved  on  the  basis  of  neW  science  and  technology  gained  at  minimum 
cost. 
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greater  opor.il  ioiuil  c.ipabi  lily. 

A  nuiiilivi  ul  I  liv  advances — usually  in  t  eCniuVIpgy  and  typically  ybou  l 
lull'  ul'  those  idem i  f  i uil  through  .i  single  system  study— arc  not  obvious 
Iv  cont  ingent  upon  any  oilier  reton I  advance.  The  relevant  science  it 
old;  the  materials  and  lubrication  techniques  required  to  implement  the 
idea  in. a  useful  form  have  been  available  lor  some  time.  Apparently 
independent  of  anything  else,  those  advances  could  occur  at  any  time; 
and  undoubtedly  the  frequency  of  their  occurrence  could  be  accelerated 
by  the  infusion  of  more  money  into  R&D  programs. 

I''--.'.' 

The  other  half  of  the  Events,  however,  are  clearly  dependent  on 
other  recent  advances  in  science  or  technology,  very  often  {os  noted  in 
section  5.1*1).  on  new  materials. 

It  is  the  latter  group  of  scientific  and  technological  advances 
that  provides  the  pacesetters.  Because  they  must  .be  sequential  in  time 
(each  conceived,  its  validity  tested  and  demonstrated,  and  its  existence 
advertised  before  it  can  be  used),  it  is  not  obvious  that  increased 
funding  will  signi ficantly  hasten  the  realization  of, advanced  weapon 
systems.  .  ■_  .  ■  >  .  - 

Moreover,  to  the  extent  that  current  management  may  be  less  than 
optimum,  there  may  be  unnecessary  delays  in  making  resources  available 
for  testing  ideas  or  in  advertising  new  scientific  or  technological  capa¬ 
bilities.  This,  however,  involves  the  management  oT  available  funds:  it 
doesn't  provide,  an  argument  for  additional  funds  or  indicate  that  addi¬ 
tion;!  funds  would  offer  any  particular  advantage. 

Next,  as  noted  in  the  findings  (section  4),  a  significant  number  of 
RXD  Events  occur  during  systems  development  and  respond  to  problems  that 
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In  brief,  tin*  criterion  for  the  icse.uch  program's  si/e  is  based  on 
tile  needs  of  future  weapon  systems  amt  othei  mi  litary  < -tf u i tinu-ii t  »  which 
in  turn  are  defined  by  future  operational  tetjui  rements.  In  tin-  absence 
of  identified  future  operational  requirements  that  c;tn  be  interpreted  as 
a  need  for  doublin']  the  research  budget,  little  gain  can  be  expected 
from  such  an  action. 

7.6,2  Acceptability  of  Reduced  Investment:  Thu  answer  to  the 
second  question,  "Would  a  10-  or  20-percenl  decrease  in  the  annual 
investment  still  bring  an  acceptable  return?"  depends  upon  intentions 
regarding  future  system  developments.  Assuming  that  the  replacement  of 
weapon  systems  will  continue  on  a  roughly  10-  to  15-year  time  scale,  as 
noted  in  the  system  studies,  the  data  suggest  that  any  decrease  would  be 
unwise. 

First,  it  is  to  be  expected  that  a  reasonable  percentage  of  the 
replacements  will  be  markedly  upgraded  versions  of  the  same  systems. 
Figure  19  demonstrates  that,  for  these  cases,  the  research  budget  should 
be  greater  than  It  was  in  the  1958-1963  period,  in  which  about  half  of 
the  new  technology  used  in  the  systems  examined  was  spawned. 

Next,  as  Figure  |i»  shows,  33  percent  of  the  requisite  new  science 
and  technology  was  generated  after  the  using  system  entered  engineering 
development.  The  need  for  many  of  those  RXD  Events  could  not  reasonably 
have  been  anticipated  before  system  design  began.  A  considerable  por¬ 
tion,  however  (perhaps  20  to  30  percent  as  a  rough  estimate) ,  could  have 
been  foreseen  and  the  necessary  research  undertaken  if  the  funds  had 
been  aval lable. 

With  the  advent  of  advanced  management  systems for  procuring 
weapon-system  development  and  the  requirement  for  detailed  contract 
definition — along  with  insistence  upon  the  use  of  fixed-price  develop¬ 
ment  contracts  and  the  introduction  of  incentive  contracts  calling  for 

v  .  .  •  . 

J;'M,  Mcyc-son ,  "Price  of  Admission  into  the  Defense  Business," 
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I  In'  I  i  :  1  iiml  perhaps  more  important  ol  I  he  two  findings  i «,  Unit, 

•.hi pi'i  s  mg  l>  ol  li'ii,  <i  p,trliiuil.ii  set  of  c  i  rcuinslances  was  found  to  ixi'.t 
v.hi'ii  a  le.illy  new  idea  was  introduced.  In  eacli  case,  the  judgment  ol 
recognised  authority  was  that  the  lesearch  proposal  off  erecl  less  pioinise 
than  another,  mure  popular  one.  The  situation  was  sufficiently  aggra¬ 
vated  that  the  less  renowned  individual  found  it  necessary  to  establish 
separate  .laboratory  facilities  and  seek  new  sources  of  funding  to  pursue 
tiis  ideas.  I  uteres  t  i  ngly ,  in  at  least  four  examples  found  during  Project 
HINDSIGHT,  lb*  new  idea  eventually  resulted  in  a  dominant  technology.  If 
reasonable  cos  (.-effect  iveness  criteria  had  been  enforced,  it  is  likely 
that  those  new  technologies  would  not  have  become  available. 

In  retrospect,  the  difficulty  of  fairly  appraising  o  new  science  or 
an  untried  technology  is  apparent.  The  basis  for  judging  either  cost  or 
effectiveness  In  those  cases— to  the  extent  that  the  situations  can  be 
reconstructed— would  not  have  bean  adequate  to  warrant  supporting  the 
research. 

Multisource  funding  is  essential  to  the  continuing  encouragement  of 
new  ideas  and  the  maintenance  of  viable  technology.  This  situation  is 
not  compatible  with  detailed  cost-effectiveness  previews  at  senior  man¬ 
agement  levels.  Clearly,  in  view  of  the  magnitude  of  the  research  ef¬ 
forts  discussed  here,  discretionary  expenditures  by  laboratory-level 
management  are  essential. 

The  second  pertinent  matter  suggested  by  the  HINDSIGHT  data  concerns 
the  typical  amount  of  time  that  elapses  between  an  idea's  conception  and 
the  beginning  of  actual  research  on  it.  The  median  delay  appeals  to  be 
a  few  days.  The  average  delay  Was  3  to  ^  weeks,  a  few  very  extensive 
<le  I  ays  iccounting  for  the  big  difference  between  mean  and  median  times. 

On  the  basis  lhat  this  was  only  a  sampling  ol  Events,  the  tentative 
conclusion  is  that  the  processes  of  research  in  science  and  technology 
.ire.  general  ly  inlolei  ant  of  extended  delay.  Presumably,  unless  resources 
•ns'  quickly  marie  available,  the  originator  of  the  idea  turns  to  other 
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Iti  r;ai  n  t  ai  n  .>111111)111111  .it  top table  t  in  i  eases  in  sys  I t-m-.  i  h*.  1  •*  I  li  >  I  i  /i-rii--, , 
the  intuit*  .innii.il  i nvt*s tinfii I  will  toiitinue  to  i  »*.*-. 

St'Vt'r.il  (h'sm’  I'll  i  1 1  ov  lot  .1  lie!  let  Management  xunicpl  ute  of  I  *  •  t 
l>V  this  study**.  liiufings,  ,m«l  tllt'it  jtitln  ions  «-ni|>  1  oynn-nt  should  imptiive 
tin*  funding  .Hit!  tun. lin  t  of  research,  In  genetal,  this  report  *>,  ■, cope 
does  not  extend  to  the  operational  i  nl  e  ip  re  Inti  on  pi  the  actual  mean*,  0/ 
which  tn.n».H|t'i!U*nl  may  be  improved.  I  lives  linen  t  in  research  by  the  Dob  ha*, 
produced  a  high  payoff  In  i  nip  roved  system*,  effectiveness  *  It  rough  the 
twin  ina  t  ion  of  several  factors.  As  stated  in  the  finding  (section  ;t .  3  7) 
A  high  combined  inventiveness,  or  ingenuity,  and  util  .i/at  joii  rate  are 
tlepentleii t  upon  the  time  anti  space  coexistence  of  four  pr’mnry  factors — 
the  recognition  of  need,  a  source  of  ideas  in  the  form  of  an  educated 
talent  pool,  capital  resources,  and  an  adequate  communi cat i on  path  to 
potential  users.  The  primary  responsibility  pf  the  Department  of  Defense 
research  managers  is  to  find  the  means  of  ensuring  the  presence  of  all 
four  in  the  proper  balance  to  meet  future  systems  needs. 
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S  i  no.*  Project  HINDS  I  GUI  began,  these  studies  Ii.ivn  hueti  given  .j 
ffii-.  i.lf  rah  If  amount  Of  exposure  to  tin*  U.S.  scientific  ami  t  eChnol  cigi  ca  l 
c.'miiiuh  i  ty  ,  «.  Ii  to  I  i  y  through  the  publication  of 'formal  papers  and  itiqui  rii: 
by  interested  people.  As  a  consequence .  ,i  number  ul  questions  have,  bouti 
raised  and  criticisms  voiced  about  real  or  fancied  weaknesses  of  the 
'methodology.  At  tin-  same  time,  participants  in  the  studies  have  also 
he->!i  concerned  with  me! hodo logi cul  validity.  For  that  reason,  the  most 
obvious  suspected  weaknesses  and  those  that  could  be  most  significant 
are  analyzed  here. 

$  •  I  Pi  f  forencc  in  Investing  tors  ‘Abilities 

Even  though  a  reasonably  succinct  definition  of  an  RXD  Event  was 
established,  the  investigator  with  the  greater  sensitivity,  experience, 
interest  and  diligence  would  identify  more  Events.  He  would  also  more 
readily  appreciate  that  there  may  be  several  Events  in  a  scientific  or 
ceehnologi cal  advance  that  a  coworker  might  consider  represents  only  a 
single  Event.  This  methodological  weakness  was  circumvented  to  some 
extent  by  using  teams  of  5,  10  or  20  investigators  on  a  single  system,  ■ 
and  this  provided  an  averaging  effect. 

More  important  is  the  fact  that  the  total  study  is  relatively  in¬ 
sensitive  to  the  exact  number  of  Events  found  in  studying  a  given  system 
In  Cases  where  only  one,  two  or  three  Events  were  identified,  the  value 
of  new  research  findings  to  weapon  systems  might  be  suspect;  or  the 
evidence  could  be  interpreted  to  mean  that  a  very  small  but  sharply 
focused  research  effort  might  suffice  for  the  future.  In  the  range  of 
20  to  hundreds  of  Events  j  however,  particularly,  where  a  great  diversity 
of  the  utilized  areas  of  a  technological  or  scientific  discipline  is 
noted,  the  evidence  clearly  denies  the  potential  of  a  limited  research 
program.  . 
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U»  this  oiul ,  tin*  iimihImm  ol  l  veil*.  .utu.illy  i«It*.it  i.l  i  i*.l  («*«  vy#ii*e 
may  lu*  »i->>igiK*it  ,i  m»i  nu  1  i  .*  i  m)  mil  I  ipl  i«*t  l.ittm  h,i*.«*«i  upnn  tin*  study 
It*  vim's  estimate  ol  tin*  iliui  tmijhnes*,  ol  its  u>vi'i.n|t*.  (Gee  s«*i.tioii 
4,1,2.)  Ihus,  lor  tin*  C-i*ll  ui retail  *.  I  inly  ,  a  mil  I  i|>  I  in  ol  'j  may  In: 
used,  with  1.35  for  tin*  LANCL  missile,  I.OJi  for  the  Mark  'j(j  mine,  ,in<l 
so  on. 

8.2  The  Experiment  's  Repeatability 

A  sampling  of  all  RXD  Events,  rather  than  an  exhaustive  study, 
tends  to  mitigate  against  the  expectancy  of  a  high  degree  of  experiment 
repeatability.  That  is,  if  a  different  team  were  to  repeal  the  study  of 
a  system— -particularly  one  like  the  C-lkl,  in  which  the  sample  studied 
constituted  about  20  percent  of  the  Events  identified — a  different  set 
of  Events  might  be  found.  Conceivably,  that  could  introduce  marked 
differences  in  the  distribution  of  factors  discussed  in  section  4, 
"Principal  Findings." 

To  measure  the  probability  that  different  groups  of  technically 
competent  investigators  would  identify  significantly  different  Events 
as  most  important  to  a  given  system,  two  separate  studies  of  the  Hark  46 
Torpedo  were  made.  One  team  investigated  almost  40  percent  more  Events 
than  the  other.  Although  the  larger  sample  still  contained  less  than  an 
estimated  70  percent  of  the  possible  Events,  it  included  approximately 
90  percent  of  the  Events  studied  by  the  other  team. 

More  important*  however,  distributions  among  such  matters  as  funding 
sources,  research-performing  agencies,  Event  costs,  etc.,  were  essential¬ 
ly  the  same.  In  retrospect,  this  is  not  surprising,  for,  without  regard 
to  the  weapon  systems  studied,  these  distributions  remained  sensibly 
constant  during  the  time  the  HINDSIGHT  data  base  grew  from  100  Events 
drawn  from  seven  weapon  systems  to  710  Events  from  20  systems. 

8.3  Basts  for  Invention  Claims 

Another  question  on  the  study  methodology  Concerned  the  teams’ 
apparent  willingness  to  accept  claims  for  inventions  in  the  absence  of  , 
patents  or  other  documentary  evidence.  In  terms  of  the  Project's  objec¬ 
tives,  this  Is  not  a  weakness;  and  in  some  cases  the  investigators  in 
fact  doubted  the  absolute  validity  of  claims.  If  the  identified  group 
was  really  not  the  original  inventor  but  honestly  thought  it  was,  as  long 
as  management  agreed  with  the  performing  group,  the  environment  in  which 
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iV  disc  iis  ss'il  in  section  6, 2. A,  "Gi'iiei.il  OliM'i  v.il  ions  tin-  t  i.iii*.  I'<  ■  I 
i>t  Ii'simi  ch  oven  t  s  |  rum  ijmli  iyi  tod  basic  research  In  system  .i|ipl  i  c.il  im 

c. in  i equine  20  years  or  more ,  ns  compared  to  nlioul  nine  years  I'm  the 

ili  reeled  basic  resouich  category.  Since  the  focus  ol  Project  II I  NOS  I  Cll  I  ■ 
Wits  on  t!te  pp;.t-l9,lb  period,  it  is  acknowledged  tiiat  lull  recognition 
has  not  been  given  to  the  long-term  growth  of  scientific  knowledge.  The 
reader  is  reminded  that  the  strategy  adopted  in  HINDSIGHT,  as  described 
in  the  Executive  Summary,  included  determining  to  what  extent  performance' 
(cost-ef  feet  ivottess)  of  new  weapon  systems  was  dependent  on  recent  ad¬ 
vances  in  science  and  technology.  Therefore,  no  valid  conclusions  can 
be  drawn  from  HINDSIGHT  concerning  the  long-term  value  of  undirected 
basic  research,  since  many  of  these  important  events  fall  outside  the 
time  frame  of  this  study  ( 1 9*16- 1963). 

8.5  Investigation  of  Failures 

Project  HINDSIGHT'S  methodology  might  also  be  criticized  because  no 
control  group  has  heen  establ  ished;  but.  failures  are  extremely  difficult 
to  define,  and  failures  or  unutilized  RXD  Events  have  not  been  investi¬ 
gated. 

For  instance,,  although  it  never  became  operational  ,  ■  the  NAVAHO 
missile  was  a  most  prolific,  source  of  useful  technology.  It  appears, 
therefore,  that  profitable  lessons  regarding  poor  research  management 
cannot  be  learned  from  a  study  of  unsuccessful  weapon  systems.  Research 
is  undertaken  in  the  quest  for  knowledge,  and  the  disproof  of  one  hy¬ 
pothesis  niay  be  just  as  important  as  the  proof  of  another.  Thus  perhaps 
only  inconclusive  research  may  be  classed  as  a  failure.  But  the  diffi¬ 
culty  of  discriminating  between  inconclusive  and  incomplete  research  is 
a  delicate  problem  that  is  well  beyond  the  scope  of  the  teams  identify¬ 
ing  P.XD  Events.  . 
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v’i’rit  r.iv  t  is  warded  invalidates  that  .issuing  I  ion. 

Holt*  sub!  K>  conclusions  must  await  ccjMiip  lot  inn  of  I  lie*  second  ins1:. 


Despite  tlu*  .^vantages  of  using  senior  in-house  Defense  personnel 
to  identity  RXD  Events,  there  was  concern  over  the  possibility  of  bid- 
on  their  part.  As  a  consequence  of  their  primary  jobs,  these  people 
have  a  personal  interest  in  the  DoD  laboratories  and  might  be  expected 
to  picture  their  parent  organizations  in  the  best  possible  tight,  this 
undoubtedly  tended  to  increase  the  number  of  Events  identified  as  occur¬ 
ring  in  the  DoD  laboratories  in  ratio  to  those  originating  in  the  univer¬ 
sities  and  industry. 

A  counterbalancing  effect  was  noted  and  described,  however,  by  sane 
of  the  weapon-system  study  teamk.  In  the  words  of  the  team  captain  on 
the  MINUTEMAN  II  study: 

it  must  be  realized  ,*  .  .  that  Industry  is  much  more  ready  to 
answer  government  solicitations  for  reports  of  contributory 
research  than  even  government  labs  or  universities  would  be 
because  of  the  profit  motive,  industry  was,  In  most  cases, 
happy  to  supply  our  leant  with  reports  to  show  their  research 
contributions  to  MINUTEMAN;  whereas  government  labs  had  often 
changed  personnel  and  did  not  have  either  the  Lime,  the  his¬ 
torical  records,  or  as  great  a  motivation  to  shot-/  their  remote 
and  indirect  contribution  to  MINUTEMAN.  Industry's  contribu¬ 
tion  was  more  directly  applied  and  more  easily  and  quickly 
ob  ta  t  ned  f  rom  records , 
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8 .  /  P  i  -.  1  r  i  lull  i  till  nl  Event  Typos 

Probably  tilt;  most  serious  drawback  in  ihis  approach  i an  inhere  it 
bias  in  the  typos  of  technical  accomplishment  uncovered,  an  uneven 
distribution  Ui-.it  can  perhaps  be  eliminated  only  by  asymptotically  ap¬ 
proaching  completeness.  Thus,  during  this  type  of  study,  a  typical 
ordering  may  be  as  follows: 

(1)  Engineering  achievements  involving  subsystems  and  major 
components.  These  were  treated  as  "elements"  or  sources  of  the  type  of 
in format  ion  sought. 

(2)  Specific  creative  activity  in  design  engineering  that  has 
the  effect  of  advancing  the  state  of  the  art,  is  frequently  patenlahio, 
and  is  essential  to  meeting  specifications.  Such  activity  has  been  in¬ 
cluded  within  the  class  of  RXD  Events  in  spite  of  its  ar/.v.-ct  character, 
since  there  seems  to  he  no  good  reason  for  excluding  it. 

(3)  Exploratory  development  in  materials  and  materials 
processing,  which  is  characteristically  performed  by  industry. 

(ii)  Other  exploratory  development,  also  predominantly 
industrial  . 

(5)  Research  performed  in  industrial  or  government  labora¬ 
tories  in  the  United  Slates  or  abroad  that  led  directly  to  exploratory 
development. 

(6)  Research  in  universities  leading  to  exploratory 
development, 
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Ti'i’  j>i  Tel  si  till  v  performed  With  .Mil  .ill  lull’  ill  lipase  group  on  T  In*  11IM.J  ■‘•t’l' 
(.ol'I'Rwl-. ,  I  ■>  IVremher  i'!i..'i)  iiul  tho  larger  slinlv  performed  under  i'.hiii  I'ai  l 
to  Arthur  I>.  I. ill  l.o,  Sue.  (I  Juno  !l)n‘i),  copies  of  which  have  l.iceii 
provided  to  your  office,  have  shown  I'lio  fc.isibi  I  lly  of  a  Method  <> I  hi  s- 
torio;il  .mu  I  vs  is  which  is  based  upon  lli'o  identification  in  weapon  sys¬ 
tems  of  tin*  most  s igni  I’ icaut  contributions  from  research  and  exp lorn  l  ory 
development  (KX1)  events) ,  These  RXI)  events  can  be  analyzed,  as  the  two 
pilot  studies  •{  1  lusiraLo,  so  as  to  identify  management  i actors  which 
.ippoaf  to  be  assoc Kited  with  their  utilization, 

A  broader  data  base  Limn  that  provided  by  the  pilot  studies  is  needed  lo 
wore  firmly  establish,  or  perhaps  disprove,  the  hypotheses  made  thus  far. 
In  addition,  a  broader  data  base  has  Life  possibility  of  providing  sonic 
seri  ol'  quant ital  ive  measure  of  the  overall  payoff  to  weapon  systems  of 
the  Department  of  Defense  investment  in  research  and  technology . 

Finally,  the  report  of  the  House  Committee  on  Defense  Appropriations 
(Report  No.  528,  17  June  1905)  has  questioned  both  the  efficiency  of 
management  and  'the  overall  payoff  of  Che  Defense  Sciences  part  .of  the 
RDTNK  budget. 

[believe  the  Lime  has  come,  therefore,  to  make  on  a  priority  basis  a 
•comprehensive  analysis  of  the  impact  of  research  and  technology  on  a 
substantial  number  oF  important  weapon  systems  now  in  use,  in  procure¬ 
ment,  or  in  tlu*  advanced  stages  of  engineering  development.  Tills  study 
will  seek:  (a)  to  identify  and  firmly  establish  management  factors  for 
research  ami  technology  programs  which  have  been  associated  with  the 
utilization  of  the  results  produced  by  these  programs;  (b)  Lo  .measure 
Lhe  overall  increase  in  cost-effectiveness  in  I  In*  current  generation  ol 
weapon  systems  compared  Lo  their  predecessors  (when  such  can  be  identi¬ 
fied)  which  is  assignah le  to  any  part  of;  Use  total  Mol)  investment  in 
research  and  technology.  II  is  currently  estimated  that,  counting  all 
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orj',ani.'.;illi>ns,  although  participation  I  rum  l In*  special  mniprol  it  organ  i- 
.'.at  ions  will  lu>  encouraged  in  arras  wlirrr  llirir  expertise  is  needed,  We 
wish,  however.  to  exclude  routrart or  organ! sat  loim  specl i'iral  I  v  hired  ]  or 
this  task.  1  hollow  the  in-house  and  sprriaJ  nonprofit  (•roups  will  «h> 
a  hot  lor  job  'than-  contractor  brgahixat  ions  because  (a)  they  liavr  broad, 
relevant  experience,,  (h)  using  the  method  of  forming  teams,  people  with 
specialised  oxpeTlenco  can  Ik’  matched  to  particular  systems,  (c)  tliey 
have  more  ready  access  to  Lhe.  necessary  information,  much  of  which  ma\ 
he  proprietary,  and  (d)  the  educational  value  of  participation  will  In¬ 
substantial.  The  iasL  poinL  la  particularly  important  since  one  of  the 
primary  goals  of  the  project  is  to  formulate  now  or  improved  policies 
Cor  managing  research  and  technology  programs. 

i  will  appreciate  your  giving  high  priority  to  requests  for  people  and 
for  other  types  of  support.  Substantial  participation  of  some  of  your 
most  able  and  experienced  people  is  essential  to  the  success  of  this 
project.  Specific  requests  will  be  directed  to  you  through  my  Deputy, 
for  Research  and  Technology.  He,  in  turn,  will  be  working  closely  with 
your  representative  on  the  steering  committee,  which  has  been  monitoring 
and  guiding  the  pilot  programs,  and  which  will  continue  tu  a  similar 
role  for  the  new  project. 

Further  details  can  be  ironed  out  at  the  Research  and  Engineering 
Policy  Council  meeting  on  July  12.  However,  if  you  disagree  with  this 
general  approach,  please  notify  me  immediately.  1  see  no  other  way  of 
satisfying  the  Congress  and  the  Secretary  of  Defense  that  we  are  getting 
:ur  money’s  worth  for  RX1).  Failure  to  satisfy  these  questions  will  nl-  • 
aost  certainly  have  serious  consequences  to  thuso  Program  Categories. 

/s/  IIAKOIii)  DROWN 

Attachment; 

Outline  of  Plans  for 

Project  HINDSIGHT 
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!  AugUSl  I 

sic!  :\.i  >.!•!.•  ;ui  I -.iMir-iMi ,  iilUiKM  ,  I'.  .•!*!•'•  i  •••!  •  I  i  I  ■  -  ■  lui  til  1'ii.jii  I 

1:1  V  -  .It.:-  .  ...  ' 

l.’.!'  >'.|  I  i  I  .n  v  I)i'|mi  I  infill  .ipi'tM  ill fin  lull  I  i  ■■■•  -  Ic.ih:  ispluin  in  ! » « - .  i  > ; 
1  if  ni 1  '.il  .nulls:',  in  .•.roup,  !n  a  :s »- r  i  * si  i:io-1  1 1 1  : ,  l.nliinl  I  :.>-ii:.<i!r, 
ill.-  I  o  .il"  f.ipl  .i  i  .  ,ii>.l  I  In-  nlfi-riin-  coinra  i  I  I  iv  •  •  I  hr  tiu.ij  m-Iii  i  ion 
I  In'  svst  fi.'i'.  Ifi,  iuili.il  study  an. I  agree  nil  iiiitis!  sliutepy  run!  p|e 
.■educes . 

I'.!.’.:  if. n:i  apt. lie.  sc  I  eel ::  fivf  members  e)  his  t  cam  Vim  :ir>-  lb  In- 
-i.i.'i i ..Mil*.!  lui  l-i  inf  ii>  this  project  lor  n  period  of  at  If. ml  \!  iiiantlis. 
if. in  :'ifi’il>.  i;;  m  o  lo  In-  selected  for  llirir  l i*c-lm i t-»i  1  compel  cure  an  wcl  1 
a-,  their  special  know  I  cdg.c  o.f  tin-  aval  fin::  being  studied.  The  appoiiit- 
•Vfiil  »  aro  made  v<- 1 1  It  tin*  support  ol  1  In1  Assistant  See  rotary  (KM>)  o!  L  lit- 
Military  IVpa  rl  inont  with  which  I  ho  loam  member  is  assoc  ini oil .  : 

Moat  onibo  ;•  1 


I'lif  entire  group  meets  for  a  '1-day  planning,  session  In  tin  l’entagun. 
i'lif  I  I'.-nii  captains.  llio  ilirocior,  and  the  steering  commi  lloc  will  continui 
tf  meet  at  regular  intervals  l lirou>;ltouC  the  study. 

Sept  onilior  J _ -  November  J 

'flu;  studies  of  tin*  first  group  of  weapon  systems  arc  performed  and 
foraploifd.  Tin-  objective  is  to  identify  and  describe  the  RXD  events, 
do  term  ini*  tin*  plneo  and  time  of  origin,  and  certain  other  factors  in¬ 
cluding  selected  aspects  of  the  management  environment  in  the  originating 
organ  teat  ion 

No y f_mhe r_  1  -  January  1 

Repiacenient  teams  of  five  members  eacli  are  formed  around  a  second 
set  i-if  systems.  The  captains  of  tiie  new  teams  will  cither  be  former 
ti.ii>..  captains  *r  be  recruited  from  former  team  members.  A  second  group 
el  •vapen  systems  are  studied. 

.i.tis  •■*  1  •  M-.i'cl.  1 

i  f .  i  .  it  i.i  ie;>!.,.-  are  formed  around  a  third  group  of  systems. 
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aratt  nt  a  smtimaiv  n*|Hirl  i  i*vi'i  ii>i:  wm  k  In  ■)  1 1  will  In- 

At  thin  linu-  an  auscmsitH'iil  wi  I  I  W  ina»li*  ifj'.anlim*.  I  lit  ikicI  uniat  i«.n  «•! 
t  lu  'Sllktv. 

II  .'.nil  nl  Ilit*  t tsiwit!  t'lin  «*ii  tin*  aVt* r,l)*,.'  aii.-i  1  v.*t*  nm*  :,y>t<*ni  |«*t 
Kit  ml  li  I  i  .  t*. ,  !»  man  nit  <nt  li:t  nl  wmk  |u*i  ; ;  v  i  •  t  i*I!i)  ,  I  ln*n  18  !,y*,t  t’lie.  will  ‘i.i 
In-tMi  fttvfi ml  in  tin*  n  month  act  ivc  Hlmlv  ini t*i  vh i  I  turn  !U*|»tt*nlu-i  I  t<* 
Mart’ll  1.  Thin  will  still  lu*  ftni**.  itlt‘i;ihl  v  lt*r,:;  Ilian  hall  I  In*  iiiv.*i.  I  gi  v 
It  mat*  In*  puss  I  hit*,  once  experience  liar.  been  j.,a  i  m*t! ,  I  u  cxpaiiil  tin*  i.lti 
in  I  In*  (aril  few  months  by  C lit*  fu mat  ion  nt  still  mote  tt'ami;.  Thj.*;  wii 
In*  tli’li't'inlinnl  al  l  1*1*  llu*  I  i rsl  llirt'i*  lt*;mm  liavt*  rump U*t  t*d  t  hr* i i  wtuki 

Hu*  Mlllt.irv  Departments  will  provide  llu*  captain  ;unl  team  memhei 
with  atlt*ii«ati*  travel  tuinh;  ami  other  iatpptii*l ,  Inc  I  ml  i  up,  till  In*  spare  a 
secretarial  serv i cos.  at  a  cent  in I  local  inn. 


Am Nn!/  !'• 

i!"t  in  1 1  inn  nl  ,i  IiV'.i'.im h  nr'  !  j >  1  ■  * i  .t 1 1 > i  /  I )i ■  v*  liipim  ii!  I  i  1-1 ; < 

‘t  A  niic  I  I'lf.'i 

«:»*!»«  •  i  I  IV  I  in  i  I  i  mi  >>l  .in  KM>  I  vcnl 

\n  KM  l  ( i  i-.t';ii  i  ll  Til  cspl  hi  il  nl  v  ili  v*-lo|>i:u  nl  )  Event  •  •  m: •  i  . I  <  I  I  In- 
.'.■.  in  u-iiri'  el  .i  novel  iilf.i  .uni  . i  j.i ili;»t,i|,ii *i! l  |>i‘i  iii’il  n|  a'  I  i v  i  l  v  • ' lii i  i:i / 
which  tin-  iili-.i  is  examined  hi  tvsti-d.  Tin-  .  l!Xli  Event  ililliii.  lini:.  u|  iii-i 
vise  simil.u  human  I'lnle. Ivors  so  I  e  lv  in  I  'li.it  t  lie  i  i'>,t  Eng  <>i  ix.uiii  n.it  i  ..n 
is  pt imur  Elv  sc  Tent i I ic  nr  t ••i'IiiihI ■  «•« I-  i  xjilnr.il  iim. 

Within  t  his  .  del  i  H  i  t  inti  1 1  in  period  of  nrlivilv  -.iinl,  llm;;,  Un- 
Event  --  is  t vpir.i I  I v  nl’  a  ri'l.il  ivoly  short  ilur;il  ion,  Irmu  ;i  Jew  Wi-i  h.  in 
.1  Tew  months.  i'Vr  example:  Al  some  I  ilno  ill  tin-  past,  1 1  ■  t  ■  i  <lcn  on  nil  i.-il 
t  n  an  individual  or  work  group -that  a  hvdrodyiiam i ra  I  Iv  generated  gas 
journal  bearing  tor  a  gyro  snipe  rotor  could  enable  ‘imp. I'ovftl  g y roseope 
character isi  ics  over  other  rotor  hoar i up,;:  currently  avai  1  ah  1  <■.  Tl . <■ 
activity  of.  ini  eivssl ,  or  Event,  would  consist  only  uf  so  much  as  iu- 
vulved  either  a  theoretical  oxamin.it  ion  of  the'  influence  of  bearing 
geometry  oil  static  ami  dynamic  lond~c.nrry  iiig  cajiiieity  or  a  s imp lo  denion- 
strafiou  that  a  rotor  1  Ike,  muss  could  ho  suppoi  tod  on  a  liydrodyiiami cully 
generated  gas  hearing  journal.  In  other  words,  only  the  initial  I  lives-- 
t  i  galion  adequate  to  demonstrate  technical  feasibility  of  tliu  f  tint!  aim  mi  - 
tal  idea  is  included.  It  is  important  to  note  that  this  Event  does  not 
oxtond  to  a  prototype  gyro  development. 

Spec  ta  1  Cons  i defat’  ions 

...  For  purposes  of  the  Department  of  Defense  study  of  RXI)  effective- 
ness,  those  Events  that  contributed  to  developing  a  weapon  or  other 
military  system  or'  a  military  capability  are  of  primary  interest.  A 
nom  ontributing  Event  might  he  of  interest  if  the  idea  has  been  tested 
and  is  recognized  as  continuing  to  be  of  a  high  potential  value  hut,  for 
some  technical  reason,  has  not  yet  been  exploited. 

Finally,  the  matter  of  idea  novelty  warrants  clarification.  The 
RXD  effectiveness  study  is  addressed  to  the  ascertaining  of  environ¬ 
ment!!  I  factors  associated  with  the  successful  prosecution  and  utilization 
of  results  of  ItXD.  It  can  be  safely  assumed  that  a  given  idea  would  get 
the  same  treatment  whether  or  not  it  was  in  fact  novel — as  long  ns  the 
noworkers  and  supervisors  of  the  innovator  thought  it  to  be  novel.  The 
criterion  for  novelty,  then,  is  solely  the  contemporary  opinion  of  the 
immediate  sponsors  of  the  idea. 

Interface  Act  ivity 

Based  on  the  above  definition  of  an  KX1)  Event,  the  history  of  the 
development,  of  a  now  device  or  component  can  be  expected  to  contain  a 
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Figure  I 


Activity 


Prior  to  the  ucrtiri'iuH'  »i  tho  idea  (at  i)  nr  I i ash  of  iiif.piral  ion, 
tiu>  innovator  was  involved  in -the  nequisi t  ion  of  knowledge,  lhruu}'.ii 
school  lug  or  experience, .  that  coincidental  ly  via:;  pertinent  to  tin-  idea. 
Each  o I  tho  minor  excursions  to  the  loll,  of  1  indicates  tin-  acquisition 
of  a  Mt  of  knowledge.  Tlioso  hits  consist  of  . technical  kiiow-liov,  oper¬ 
ating  environmental  factors  .and,  perhaps,  operat  loiml  requircmeni  s.  At 
l,  some  tri.gBori.ttjx  element  enabled  the  culminating  of  all  of  I  Vn-  pre¬ 
cedents  into  the  Idea.  S»il>»o«|iient ly ,  the  idea  is  shown  to  In-  under  ac¬ 
tive  Invest i Rat  ion. 

Continuing  with  the  generalization,  assume  that  Lite  output  of  the 
above  Event  is  in  some  manner  related  to  another  innovator.  If  the 
latter  individual  makes  use  of  the  information  in  the -developing  if 
another  idea,  the.  information  concerning  the  first  Event  becomes  one  of 
die  minor  excursions  in  the  latter's  knowledge-accrual  diagram,  as  in 
Figure  2.  . 

Figure  2 


Preceding  Page  Blank 


1.  inu- 

A  short  descript  ive  title  ideal  I  I'v  Inj*.  tin1  aetivitv  (e.g.  ,  ih-vi-lop 
atiuH  ,  demount  rat  ion,  invest  igat  ion,  a duly,  etc.)  which  ctiiiiiiunl  «•«!  to 
under-M  atnliue,  ot  phenomena,  dcmonst  nil  Emu  u f  prim- ip !«•»;,  or  speeilli 
embed  unit  of  pfinolpli's  (e.g.»  technique,  device,  material,  etc,), 

[Note:  An  RXI)  Kvi'iit  is  coue.eived  here  as  eor  respond ini-  to  a  period 
ot'  t oehuiea I  activily  with  a  wel  I -do  fined  end  point  (e.g.,  tin*  prepara¬ 
tion  of  a  report,  presentation  of  a  technical  paper  at  a  professional 
society  moot  inn,  patent  disclosure,  demonstration  of  f  uus  i  ti  i  lit  y  or  an 
idoa  by  mathematical  analysis  or  breadboard  or  brasshoard  modci  ,  etc,). 
Typically  a  creative  or  innovative  .net  is  Involved.  Caie  should  be¬ 
taken  to  avoid  (a)  inclusion  of  normal  engineering  activity  within  the 
contemporary  state*  of  the  art,  (b)  lumping  a  number  of  KXI)  l.  vents  Into 
an  i  1  l-dof iiunl  class  of  such  activity,  and  (c)  confusing  manufacture'll 
hardware  with  RXD  livents.1 

» 

2 ,  Weapon  System 

Same,  Including  the  standard  nomenclature  and  the  common  name  if 
.needed  for  easy  identification. 

} .  Subsystem 

Reference  lo  an  analysis  of  the  weapon  system  into  immediate  and 
separately  identifiable  constituents,  arbitrarily  adopted  as  standard 
for  purposes  of  tiiis  study. 

[Note:  For  this  purpose,  overall  System  Concept,  Aerodynamic 
Configuration,  etc..,  will  be  treated  as  subsystems  where  considered 
appropriate. J 

III  cmi-nt 

Reference  to.  an  analysis  of  the  subsystem  into  immediate  and 
•sep.irat i-ly  identifiable  components,  considered  as  involving  RXD  Kvents. 

(.Note:  For  this  purpose,  the  Subsystem  tXsneepl  ,  or  the  subsystem 

it  ..-If,  .is  dr-fined  abovi*,  will  In-  treated  as  an  element  where  emtsid- 
•  « .-i|>(0',,|>|- j;|(  e.  | 
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A  short  statement  >•  l.ni  I  v  i  n>>  llir  lyiii'i  ir  ii.it  u  r .  ■  u(  tin  I.vrnl  , 
scient  il  ip  research,  exploral  orv  ni.il  or  la  Is  <lrvr  li)piin,nl  ,  in.imil  ,i.  I  m  iiiji 
process  deve  1  opulent  ,  parent cd  invention  ri*:;n  I  t  iiig  inn  design  nc.-in.ii 
ith’,,  i'll'.  (The  purpose  of  llii:;  si  at  rntrn  I  i In  i::t  in.  r  1  j|*jjj|:  1 1  i  r:it  i  i  a 

of  UXIO 

i .  Ki »y  IVrsoniii'l 

•  Tin*  names  of  I  he' individuals.  having  signirirniii  roles  in  tin.-  KXb 
Kvi'iil ,  with  :i  bri of  (loser ipt  i/.in  of  each  one's  ro.lt;,  background  .-me!  expe¬ 
rience.  (Kvery  reasonable  attempt  should  be  matin  to  gel  copies  of  t  Im¬ 
personal  biography  (resuiw?)  of  the.  individuals  identified  an  having  |iinde 
;i  direct  contr  Unit  ion  to  tin*  RXD  Kvont.  these  resumi'.:  should  br  appended 
to  the  Kvont  Description  form.  )  The  key  personnel  may  bo  eitipj oyoit  in 
tho  organ  i  -/.at  I  on  whore  the  RXD  was  performed ,  in  a  government  project 
off  Lei'  or  laboratory,  or  elsewhere . 

fi.  Date  of  Kvont 

The  year  in  which  the  specific  KX1)  Kvont  activity  terminated  (see 
1  above).  A  more  detailed  specification  of  the  date  should  be  included 
when  available.  A  starting  dale  (approximate  or  estimated  if  necessary), 
consistent  with  the  interface  activity  preceding  tho  HX11  Kvont  described 
in  11  below,  should  lie  indicated.  These  initial  and  final  dates  should 
also.be  consistent  with  the  financial  descriptions  of  item  12. 


9 .  Duration 

file  approximate  longLli(s)  r»  t  time  covered  by  Hie  spec  i  fie  tieliai  cal 
activity  having  the  termination  in  8  above. 
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Or 'i'.iii i  *.*i t  i mis  **l  Ii  » i  t  li.iti  I  li.it  i.-ln  i.-  !l.»  KXII  1  v*  1st  wu:.  jm  i 
ti'im.'il  \i  *.•;.,  a  |iovi>iiimt'Ul  |»ii»livt  nil  i*i>  in  I  .iIm.i  . ,  t  <>  iv)  i::a  v  have  jj  9  ;sv**tl 
in  import  an!  pari  in  lb-*  KNI1  Event  ,in*l  should  .ilsn  In-  i:l**nl  i I  I ed  where 
upprbp  r  i  .it  •' .  | 


II.  OtS-.mi.-.al  ion  Type 


Tin*  generic  typos  of  organizat  i t>n  eo r respond i n j-  to  It)  above.  Tills 
should  contain  sufficient  doscript tvo  material  to  clarify  fully  the 
types  of  organization  and  organizational  subdivision  In  question,  e.g., 
industrial  (prollt.) — corporate — research  laboratory,  Industrial  (profit) 
—operating  divis Ion— design  engineering  organization,  university- 
operated  Department  of  Defense  research  laboratory,  etc.  The  purpose  of 
tills  paragraph  (see  also  b  above)  is  to  assist  in  the  classification  of 
organization  types. 


id.  Financial  Support 

Specific  information  on: 


a.  .The  source(s)  of  funds.  This  should  include  information  con¬ 
cerning  both  the  internal  accounting  treatment  of  the  funds  used  and  tiie 
ultimate  sources  of  funds.  Where  the  work  is  sponsored  by  the  govern¬ 
ment  or  other  sources  external  to  the  organization  (10  above),  specific 
contract  or  subcontract  numbers  should  be  identified  where  possible. 
Where  this  decision  is  made  by  the  organization  (10  above)  to  initiate 
the  activity  represented  by  the  RXD  Event,  the  way  in  which  the  costs 
are  recovered  or  treated  should  be  clarified  (e.g.,  the  expression 
"coft.iany  funds''  snould  refer  only  to  the  nonrecovered  expenditure  of  a 
comp.i**y'8  earned  surplus;  where  subsequent  recovery  in  the  sale  of 
prodetr  or  in  negotiated  overhead  on  government  contracts  is  involved, 
it  on  Id  i'v.  so  stated),  . 


The  time  duration  of  each  source  of  funds. 
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.  Whole  .i.lvlilii-ii.ll  I  ninl  ini*,  w.i::  i  i*<|n  i  1 1*.|  in  •  >  i  <lti  t ..  l.i  in;*  t  !»• 
losiilt:;  .*1  I  It.1  BXU  Kvi-iil  ,1  v*  .1  l  ll  1 1  v  n  ■ :  i  •  |  ii  I  |*u  i  nI  willmul  ..|  i:«*i  in'  •- 1 
will  iii*,  ovenis,  l  In*  tnl.il  r'o.-il  should  In*  shown  heir,  A 1 lei  nut  i  *.n*  I  v ,  il 
l  In*  RM>  Event '  occurred  during  III!*  1*11111!:.'  I.*l  a  l.diei  at  oi  v  .*•■■:.  I .  t  i  1  n*  *  I  j.m 
g  r.i'.ii  in  .i  1  v'v*liiii*K>j*,v ,  .1  rough  idea  ;i::  I  ii  tin*  I11l.1l  .11111t1.1l  |nii)*iaiii  *.i:*<- 

should  In*  rnicrotl.  iThls  genera  1  1 V  does  mil  apply  In  (In*  i.'im*  o.  <111  KM» 

Event 's  iHi'iui  i  iii*.  as  pari  nl  a  weapon  ~syst  <*in  <lt- vi- fopim -n  t  project  'Inn* 

tin*  event.  was  funded  as  pari  nl  I  In*  project  ;  and  no  cut  ry  is  r>*i]ii  i  i*  ■  !  in 

i  lif«  paragraph .  1 

[  No  U* :  Host  informal  inn  should  In*  given  in  I  nnn::  nl  Lotui  (i.i*.., 
•lullv  burdened)  i*  os  I  and  such  i*sl  imalns  should  In*  I'  or  lin'd  ,  where  possible, 
if  the  account ing  practice  of  the  perlorinihg  organ  ixat  ion  nl  i  ft '«*rn  in 
lit  is  rosport  .  ] 


13.  Svs_t_om  Interlace  Activity 

,  a.  In format  Ion  concerning  the  way  in  which  the  KXU  Event  was  uti¬ 
lized,  that  Is,  the  steps  by  which  it  was  .incorporated  either  in  subse¬ 
quent,  related  RXD  Events  or  systems  or  in  2,  3  or  4  above.  Wherever 
possible,  specific' 'event's  should  be  identified,  o.g.,  the  preparation  of 
a  proposal,  etc. 

b.  information  concerning  prior  RXD  Events,  system  activity  or 
incidents  which  contributed  to,  influenced,  or  provided  a  motivation  for, 
the  RXD  in  question.  Iii  particular,  where  government  sponsorship  of  the 
RXD  work  is  involved,  state  whether  the.,  technical  initiative  resided  in 
the  performing  organization,  the  government,  or  elsewhere. 


14 .  RXD  Event  Circumstances 

Miscellaneous  information  relating  to  the  RXD  Event  but  not  else¬ 
where  classified.  Management  environmental  information  may  be  recorded 
here.  Wherever,  because  of  the  nature  of  the  RXD  Event,  it  is  possible 
to  demonstrate  a  relationship  between  the  cost  ol  the  RXD  Event  and  tin- 
cost  sayings  to  the  government  of  either  the  final  weapon  systems  or 
specific  delivered  hardware,  this  information  should  be  identified  and 
reported  here. 

11.  Sources 

Documents,  persons  interviewed,  etc. 


Author:  leiop 

Date  of  preparation: 

Attachment:  Example  of  RXD  Event  Description 


Telephone  number': 


At  1 .1*  iRM’til  In  A]'jM*Ilill»  I 
R X 1 1  I  yen!  lie.si  rip-1  inn 

I.  title:  »>l  I'mcMne,  ,1,1  nihil  ittp  !!.il  el !  i  I«-  I « %'  M.  ,i:»m  Ui;* 

t  in*  1  *1  *|*i *  1  «*  i  'Uli  *  I  l  t.\  iM 

System:  N.ivv  X.ivig-'ii  imi.il  S.iivl  1  it*-  ev.-:i  em 
t,  Mih.!  vs!  cm:  IT.iek  i  ui'.  Sl.H  inn 
•i ,  Klement:  Doppler  Kbit! 

*,  IVchnio.il  St  {ini  l  iiMth'i*: 

a.  Origin,  Techii i ca I  Activity  and  thilfomc: 

Till!!  event  is  the' concept  ion  m  id  »l  win  lustration  of  determining 
tin*  orbit  of  a  near  -eart  h  satellite  on  a  single  pass  by  an  accural  c 
measurement  of  tin*  Doppler  shift  pattern  In  llu*  radio  signals  trans¬ 
mitted  by  the  sat  ei  I  i  le.  The  Doppler  offer l  is  an  apparent  change  in 
frequency  caused  bv  the  relative  motion  between  transmitter  and  receiver. 

b .  Relationship  to  Contemporary  Science  and  Technology:  ... 

At  Llu*  time  of  this  event  there  were  ..everal  methods  of  tracking 
satellites.  Optical  tracking  instruments  using  the  visible-light  purtion 
iif  the  elect  romagnot  U:  spectrum,  sueli  as  the  Buker-Nunn  ballistic  camera 
which  del  ermines  angular  position  by  photographing  the  vehicle  against  a 
star  background,  are  highly  accurate.  However,  their  capability  is  lim¬ 
ited  by  darkness,  clouds  and  haze-.  Also,  the  data  require  specialized 
hand  ling,  sonic  limes  delaying  the  output  beyond  the  period  of  usefulness. 

infrared  radiation  from  the  satellite  permits  it  to  be  tracked 
through  some  haze  conditions,  but  infrared  is  absorbed  by  the  lower  at¬ 
mosphere,  limiting  its  detection  in  ground  stations. 

Radio  tracking  techniques  included  radar  scanning  for  the  di¬ 
rection  of  the  strongest  signal  arid  interferometer  comparison  of  signal 
phases  received  by  separate  antennas.  Mini track,  which  operates  from 
the.  laLter  principle,  depends  on  a  transmitted  frequency  to  establish 
the  line  of  position  between  the  satellite  and  Lhe  Lraeking  station. 

While  Min  it  rack  uses  a  small  part  of  the  Doppler  shift  te  meas¬ 
ure  miss  distances  and  cannot  determine  the  orbit  in  a  single  pas:;.  Ibis 
even  I  derives  all  sis  orbit  parameters  from  the  total  Doppler  shift  in 
one  pass.  Using  scalar  as  opposed  to  vector  measurements  allowed  vast 
simp  Li  float  ions  while  retaining  accuracy.  For  example,  only  small  an¬ 
tennas  with  a  minimum  exposure  were  required.  Bumblebee  Series  Report 
No.  'I'th  was  issued  April  1958  and  distributed  to  anyone  interested  in 
satellite  tracking. 
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i'lll*.  I-Vfllt  c-flrllli.ll  lul  I  111-  1 1 1  Vi  ■  l  r .  I  -  i  •  i|  i«  '-|*l  It'll  1  I  ■  [<  !  >  | 

!ii  in  1  ill’  tin-  ii-n-ivi-i  pi'iil  inn  liv  llopp  1 1  i  il.it. i  i.-ln-n  l  !■«  -  ..n.  Mil.  -iilil  i 
.  1 1- »•  ti  1 . 1 1 « ■  I  v  I.  llin.’li,  rilin'  i  ill*. i  in  t  ip. Mod  1  III-  •  l>  >/«•  I.  'I'lin  i.l  ■!  !  ’ .  ■  '..c.-v 
S.IV  i  .-_.lt  i  1M1.1  I  .‘i.ll  <■  I  t  i  1 V  Sy.t  fill.  L 

ii.  iyjpc  i'l  KX1)  I'v.-ut  :  Kcsc.i rtli 

/.  ko  V  l‘f  I'Ml’lllH'  I  : 

■Hr.  William  duier,  Thi-mvl  icn  I  I’hvs  i  o  i.-.l  ,  Xi-scarrii  Conli-i.  flon 
reived  tlif  event  w  illi  Wi*  i  M  cnhaeli .  Hi::  I  lair  willi  i-iiinjuil  i- 1 1.  wa:.  a  pif.it 
.till  in  reducing  tin-  Iiopp  I  i'i'  shill  lu  Jip.il. il  luriu  In  ili-vi- 1  i»[j.  i-i.iiiput  at  inn 
al  l ivlu\i.|ui'M  lor  e.\l  rncl  ing  orbital  ilal.i. 

Hr.  iloorgo  We  i  f  I  enhaoli ,  Theorel  leal  i’hyr.i  ■’  i  a  t  ,  Research  Cpulcr. 
Conceived -i  he  ovont  and  was:  pr  im.tr  i  I  v  responsible  lur  I  ho  accurale 
measurement  of  l  ho  Doppler  alii  ft. 

llonry  Ribldl,  Supervisor,  HID  Croup .  experience  in  missile  tulinii- 
etry  coni r Ihul oil  in  hist  selling  up  c Lot* l  runic  cqiiijuneiti  for  tlu*  aecpiisj- 
t  ion  of  experimental  Jala. 

I)r.  Rr  R.  Newton,  Thoorotical  I’hysic  1st,  Research  Coil  lor .  Ansi  slot! 
in  Lhoorel  ical  analysis  from  Clio  stand  point  of  celost.  i  al  raechniries. 

Also  assisted  in  programmi ug. 

8.  Paid,  of  Ivvcnt: 

a.  Termination:  April  1958 
1).  Initiation:  October  1957 

‘  •  V  ••  • 

9.  Duration:  Six  months 

10.  Organization:' 

a.  Johns  Hopkins  University 

b.  Applied  Physics  Laboratory 

c.  Research  Center 

d.  The  Research  Center  participated  in  many  phases  of  basic 
unapplied  investigation. 

11.  Organization  Type:  Oovornmeut  laboratory 

12.  financial  Support: 

a.  Source:  in-house  Task  1)  (D-5A)  •  funds  for  basic  research 
h.  Duration:  Six  months 
c.  Amount:  Kst limited  $1 A ,000 


Hl8 


..  I  IV! 


*  * i  .  *  *  5  »  r  *  •*  » 
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’»;(  t  I  .  *  ;  f  I-.  .1  ,1  |  1,1  *|j*i  .||.»  I  *,*»  I  |  II*,!  *  I  .**  *  ill,*  si  -|l  i<-*.  ,  » r 

, ■  .1  .*  ■ !  i  ■ - *»*  *  I  *,  1 1  l***|*|*  I  *  i  "**-*il  *'"i*  :*!■..**!  I  ***■•*!  ss  I  I .  I  i ,,  j*  •  I  -  i  ,  s*  t  <  ,  .*, 

i  - 1  *  ,  -  *  t;t  %  i  Hi  1 1:*-  I  -I*!, 1 1  e  .11  -t|u*  I.i  I  » **ii .  lb,  tioppl  *  i  I  *  *  In*  t*ri«  I-  *  !  *  «  ■ 

is,,.;  i  ,*  I  i.i,  -  ,  1 1  !  sut  .*  .pietit  A  I' I  *.,if  *  •  I  1  i  I  *  *■  ,  m*l  ?**  •!  I  *  -  II,**  -I*  .  *  !  ■  -|-:  *  i.i 

.*!  Is,  \,n*.  X.*vi  oat  |,*n  il  .1  !  il .  Sv:.l  *•!». 

i'i  *  v> **n*-  A*'i  I  vt  i  v: 

i-ii  i  *-r  ,in*l  KVi  Moiil-ach  gatht-icd  all  the.  limned  i  i!  **l  y  uv.ill.l  I* 
iv,  I'lviii.*,  «*tiii  i  pneut  iiiul  t  ape  i  **i*t*i  *!**  i  s  l«*  1  is  I  eii  l  *  *  l  1 1*  ,t.'  ’ 

.spill  II 1 1*  1  ,lll**I  ill!  I.lllltcll  im  V  l)**li*ln*l  l1!1)/.  I*'  1 1  H*|  I  h  i *•  I  ii»!»  I  l.t*  \  il,.,* 

station  1  tn*v  Iinl  i  *****  1  ,i  pr  I  ill!  *11111*. *.l  iNippli*!*  ;:Ii  1 1  I  In  tin*  t  t  i  :-*  *<*:*  It  *• 

quencv  and  ns*  I  i.’rtl  that,  il  I  liov  emil'tl  ueriiiutoh  r,*i  !**n  I  ;t  I  *  Hi*  si.  i  I  !  , 
those  t'.l  I  i*ll  I  lit  i  OHS  Would  li'll  .ill  1)1  !  Ill'  miii  I  |».ll  *1I:m-I  III,  and  plnvidi-  a 

good  l  rack i iij*  technique.  Till.*:  wnulil  pari  It’ii I, irlv  aid  idrnt i t  ioat ion  o( 
Sputnik's  signal  wti |i*li  was  in  an  overcrowded  region  ol  Hu*  HI  sport  mi:.. 

14.  i:\li  Keen  I  (I  i  ivtimsl  uncos : 

Hr.  Frank  McClure,  lllia irm.i n  of  tin. •  Research  Center,  wan  nkupl  ica  I 
of  tin*  possibility  of  accurate .1  y  tracking  a'  sate.1  I  lie  willi  the  Doppler 
l eehn itjut*;  however,  ho  support  oil  a  serious  continuation  of  tin*  initial 
investigation  although  no  practical  application  was  in  sight  at  this 
t  inn*.  Originally  tin1  orbital  paramo  to  vs  were  worked  out.  with  a  slide 
rule,  but  Al’l,  fortuitously  acquired  a  Univac  1101  which  permi  tted  much  . 
quicker,  more  accurate  computations.  Because  Hie  machine  was  new  and 
priorities  hud  not  been  established,  the  computer  was  available  day  and 
night,  0.  V.  Bit  toi  l  i,  who  worked  witli  the  computer,  became  very  inter¬ 
ested  in  llie  Doppler  theory  and  creutivcly  experimented  with  computer 
Input  and  calculations.  After  two  monLhs  of  study,  the  Doppler  curve 
looked  more  and  more  sensitive  ami  unique,  and  its  reliability  in  pri¬ 
ll  feting  orbit  was  much  greater  than  anticipated.  Eventually,  good  tape 
recorders  and  soph  l st  I cated  radio  tracking  equipment*  were  acquired  to 
validate  the  Doppler  method. 

Important  to  tin*  success  of  this  event  were  the  freedom  allowed 
oilier  and  We  i  f  f  enliaeh  and  the  acquisition  of  the  lintvar  1103  at  a  criti¬ 
cal  time.  The  enthusiasm  generated  by  the  key  participants  led  many 
individuals  to  work  on  their  own  time.  In  early  ID5S  n  geodesist  I'rotv, 
i  he  Annv  Map  Service,  O'Keefe,  somehow  round  out  about  the  Doppler  re¬ 
search  at  API,,  gave  new  encouragement  to  Hie  investigators,  and  also 
i  ml  i  eat  ed  sum**  further  questions  to  be  answered,  lie  was  the  t  i  rst  out- 
*;i*|.*  *if  API.  to  I'l'i'ogii I zo  the  significance  of  the  Research  Center's  work. 

*  1 1  beui'.li  tin*  Naval  Research  haburutory  was  concurrently  doing  related 
sort  with  Min  it  rack  and  Vanguard,  no  interns!  was  shown  in  APi.’s  studios. 
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APPENDIX  I) 


Summary  of  RX_D  Events 


Note:  Numbers  omitted 
from  the  consecutive 
series  represent  reports 
withdrawn  from  the  study. 
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SUMMARY  OF  RXD  EVENTS  {cont:n....-ti| 
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0432  Development  of  a  Waveform  with  No  Ambiguous 

Ranges  or  Velocities  for  Use  with  a  Clutter  Rejec¬ 
tion  Radar  1965  Profit  Laboratory,  inriustria! 


0433  Development  of  a  Rotating  Phased  Array  Incorpo¬ 
rating  Aircraft  and  Scanning  Motion  Compensation  1964  Profit  Laboratory,  Industrial 


Charge  Liners  1952  University  Operate* 
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-SC.VMAP.Y  OF  HXD 


SUMMARY  OF  RXD  EVENTS  (continued) 
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.SUMMARY  OK  KXIJ 


Control  ITYC)  by  Mechanical  Spoilers  (Jetavatorsl  1350  wovovnmont  laimraVn 
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4060  Development  of  Zero  Length  Nonvertloal  Missile  Government  Lnhor.it 

Launch  1959  University  Operated 


Determination  of  Most  Desirable  Compromise 
Amonfc  Shock  and  Bubble  Energies  for  an  Under¬ 
water  Explosive  1937  Government  Labor a:-*rios 


Best  Available  Copy 


APPLNDIX  I. 

WoO  fundi ik|_  for  RDT&t  arid  Estimated  RXD  Expenditures 

The  following  table  shown  total  Doll  funding  for  RD'i’&K  from  1947 
through  1%3.  Thu  estimated  RX1)  expenditures  are  bused  on  the  assump¬ 
tion  that  about  20  to  25  percent  the  RliT&E  funds  was  spent  on  research 
in  science  and  technology. 


Year 

Total  RDT&E  Funding 
($  millions) 

Estimated  RXD  Expenditures 
($  millions) 

1947 

515 

118 

1948 

534 

123 

1949 

608 

140 

1950 

539 

124 

1951 

758 

174 

1952 

1 ,164 

268 

1953 

2,150 

495 

1954 

2,187 

505 

1955 

2,261 

520 

1956 

2,101 

485 

1957 

2,406 

555 

1958 

2,504 

575 

1959 

2,860 

660 

1960 

4,710 

1 ,080 

1961 

6,131 

1,410 

1962 

7,643 

1 ,308 

1963 

7,638 

1 ,445 

46,709 

9,995 

195 


